MEMORANDUM December 18, 2015 
TO: Board Members 


FROM: Terry B. Grier, Ed.D. 
Superintendent of Schools 


SUBJECT: 2013-2014 ASPIRE Award Program Evaluation 
CONTACT: Carla Stevens, 713-556-6700 


On January 12, 2006, the Houston Independent School District (HISD) Board of Education 
approved a teacher performance-pay program awarding teachers financial incentives based on 
three indicators of performance pay. These indicators involved group performance for teachers 
based on campus second grade comparative growth in mathematics and reading and EVAAS™ 
department cumulative gain index within a subject; group performance campus-wide based on 
the EVAAS™ campus composite cumulative gain index and campus growth or achievement, and 
individual teacher performance based on student progress on state and district assessment 
programs (EVAAS™ teacher composite cumulative gain index). 


After consultations with national experts, teachers, and administrators, the teacher performance- 
pay model was improved and enhanced, which then became the ASPIRE Award, one 
component of the district's ASPIRE (Accelerating Student Progress: Increasing Results and 
Expectations) school improvement and performance management model. The purpose of the 
HISD ASPIRE Award Model was to reward teachers for their efforts in improving the academic 
growth of their students. ASPIRE Award employs a value-added methodology that provides 
teachers with the information they need to facilitate and measure student progress at the 
student, classroom, and campus levels. 


Attached is the evaluation report summarizing the effectiveness of the 2013-2014 ASPIRE 

Award as required by federal grants. The following analyses are included in the evaluation: 
e Award Payout by model and year 

Recruitment and Retention 

Teacher Attendance 

Student Academic Performance 

Survey Feedback 

Distribution of Highly Effective Teachers Across the District 


Should you have any further questions, please contact Carla Stevens in Research and 


Accountability at 713-556-6700. 
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ASPIRE Award 
Program Evaluation, 2013-2014 


Executive Summary 
Program Description 
In January 2007, the Houston Independent School District (HISD) inaugurated the Teacher 
Performance-pay Model, 2005-2006, becoming the first school district in the nation to implement a 
performance-pay system of this magnitude based on individual teacher effectiveness. The experience gained 
in the first year and consultations with national experts and teachers provided the impetus for recommending 
the improvement and enhancement of the model, which became the “Recognize” component of the district’s 
comprehensive school-improvement and performance management model, “Accelerating Student Progress: 
Increasing Results and Expectations” (ASPIRE). The ASPIRE Award has been successfully paid out annually 
every January since 2008. Revisions were made to the model for the 2013—2014 school year, which was paid 
out on February 4, 2015. 
The purpose of the HISD ASPIRE Award Model, which was adopted by the Board of Education on 
September 13, 2007 (original model was adopted on January 12, 2006), was to reward teachers for their 
efforts in improving the academic growth of their students. ASPIRE Award employs a value-added 
methodology that provides teachers with the information that they need to facilitate and measure student 
progress at the student, classroom, and campus levels. 
The ASPIRE Award is dedicated to achieving the following goals: 

e Encourage cooperation in Professional Learning Communities; 

e Be aligned with the district’s other school-improvement initiatives; 

e Use value-added data based on a national expert’s methodology to reward teachers reliably and 
consistently for student progress; and 

e Include core teachers at all grade levels, early childhood through grade 12. 


The ASPIRE Award is based on the same five assumptions and principles as the original Teacher 
Performance-Pay Model. These include: 
e Performance pay drives academic performance; 
Good teaching occurs in all schools; 
Teamwork is valuable; 
Performance pay does not replace a competitive base salary; and 
Performance pay systems are dynamic and evolve over time. 


Given these goals and principles, the ASPIRE Award involves three different indicators of academic 
performance: Individual Performance: (value-added core teacher progress); Group Performance: Teachers 
(department value-added or comparative growth); and Group Performance: Campus-Wide (campus value- 
added and campus growth or achievement). Indicator Ill is based on the EVAAS campus composite 
cumulative gain index and the Stanford and Aprenda reading and mathematics performance (percent of all 
students at/above 50' national percentile rank, across all grades) for middle and elementary schools and 
Advanced Placement (AP)/International Baccalaureate (IB) participation and performance for high schools. 


The purpose of the evaluation was to assess the effectiveness of the 2013-2014 ASPIRE Award 
program in relation to the stated goals and the impact on the participants after nine years of implementing a 
performance-pay program. The logic model diagramming the inputs, activities, outputs, and outcomes is 
illustrated in Appendix A, p. 52. The program evaluation is required as a part of federal grant funding 
requirements. To accomplish this, the following research questions were addressed: 

1. How many participants received an award, and how much money was awarded district-wide for the 
2013-2014 ASPIRE Award? How does this compare over the past eight years? 

2. Were there any common characteristics among the instructional staff that received an ASPIRE Award 
over the past two years? 

3. Has the program helped the district to recruit and retain teachers, especially effective teachers 
providing instruction to high-need campuses, grade levels, and/or subject areas? 

A. Have there been any changes in teacher attendance since performance-pay has been implemented? 
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5. What were the levels of completion for the ASPIRE training courses? 
6. Has the implementation process been improved as measured by the number of formal inquiries 
submitted? 
7. Have students shown academic gains in the four core content areas based on standardized test 
performance for 2005-2006 through 2013-2014? 
8. Based upon survey results, what were the perceptions of respondents regarding the 2013-2014 
ASPIRE Award? How does this compare to previous years? 
9. Based upon survey results, what was the level of effectiveness for communicating information about 
the ASPIRE Award? 
10. Based upon survey results, what recommendations were made to incorporate changes to the 
ASPIRE Award? 
11. How are highly effective teachers based on value-added analysis by subject distributed in schools 
across the district based on school poverty? 
Highlights 


Award Payout 


Since the inception of a performance-pay program, the district has paid out $249,311,622.82. There 
was an increase of $3,840,631.83 from 2012-2013 to 2013-2014 due to changes in eligibility and 
award model calculations. 

When comparing the total payout from the 2005-2006 Teacher Performance-Pay Model to the 
2006-2007 newly designed ASPIRE Award, the payout increased from $17,007,023.31 to 
$24,653,724.71 in 2006-2007. 

Over the past eight years, the total payout increased from $24,653,724.71 for the newly designed 
2006-2007 ASPIRE Award to $42,467,370.00 for 2009-2010 ASPIRE Award, but due to changes in 
funding decreased to $21,923,198.33 in 2013-2014, and due to changes in the award model the 
number of staff receiving an award decreased from 13,157 in 2006-2007 or 77.6 percent of eligible 
staff to 5,772 in 2013-2014 or 50.7 percent of eligible staff. 

For 2013-2014, 60.5 percent of all eligible core teachers received an award, reflecting no change 
from the previous year, and an increase of 1.3 percentage points for all eligible teachers from 2012— 
2013. 

The average payout for core foundation teachers (Group 1-3), rounded to the nearest dollar, 
increased from $4,458 in 2012-2013 to $4,924 in 2013-2014. Similarly, the average payout for all 
teachers (Group 1-4) increased from $4,072 in 2012-2013 to $4,431 in 2013-2014. When comparing 
2012-2013 to 2013-2014, there was an increase in the average award amount for core teachers by 
$466 and all teachers by $359. 


Recruitment and Retention 


Of the 607 core foundation teachers (Group 1) receiving a recruitment incentive and/or stipend 
(critical shortage stipend or recruitment incentive) for whom individual award data were available, 
312 employees, or 51.4 percent received both a Group 1, teacher progress award, reflecting highly 
effective teachers, as well as a recruitment bonus. Out of 2,202 core foundation teachers with 
individual data (Group 1), 1,014 employees, or 46.0 percent, received a Group 1, teacher progress 
award, but no recruitment bonus. 

Classroom retention rates for teachers were 88.6 percent in 2007—2008, rose to a peak of 90.9 
percent in 2008-2009 and then declined to 79.5 percent in 2013-2014 cohorts. During the 2010— 
2011 school year, budgetary cuts were responsible for the loss of teaching and other campus-based 
positions, which affected this number. 

The percentage of core teachers that were retained in the classroom and received a Strand 2 or 
Group 1 award for teacher progress increased overall from 61.9 percent in 2008—2009 to 62.1 percent 
in 2010-2011 and then declined to 34.6 percent in 2012-2013, followed by an increase to 40.8 
percent in 2013-2014. These percentages reflect more stringent award model criteria and 
calculations. 

The percentage of teachers in hard-to-staff schools receiving bonuses related to classroom level 
performance declined by 45.5 percentage points from 67.7 percent for the 2005—2006 cohort to 22.2 
percent for the 2013-2014 cohort, although this reflects an increase of 2.5 percentage point from the 
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previous year. These declines may be attributed to changes in the award model as well as changes 
in the schools identified as hard-to-staff. 


Teacher Attendance 


Teacher attendance rates, using only requested absences, increased from 94.8 percent in 2004— 
2005 (before performance-pay) to 98.5 percent in 2009-2010 (performance pay year 5), but declined 
to 95.3 percent in 2013-2014. This decline may be attributed to the elimination of the attendance 
bonus in 2009-2010, and the increase may be attributed to the 10-day instructional day eligibility 
criterion. The attendance rates are based on the year of program implementation, while payout 
occurs during January of the following year. 

Teachers who received performance pay had slightly higher attendance rates than the district 
average. This is likely influenced by the minimum attendance requirement implemented for eligibility 
when the attendance bonus was discontinued. 


Student Academic Performance 


For both 2013 and 2014 the state outperformed the district in the percent of students that met the 
initial phase-in for Satisfactory Level II for STAAR grades 3-8. For 2014, the highest percentage of 
HISD students met the phase-in standard for Level II in Reading/ELA and mathematics (69 percent 
for both), while the lowest percentage of students was in social studies (54 percent). 

For 2013 and 2014, the state outperformed the district in the percent of students that met the 
Advanced Level with the exception of writing and mathematics, where both the district and the state 
had the same percent of students meeting the advanced standard. 

For 2014, the state outperformed the district when looking at the percent of students that met the 
phase-in standard for Satisfactory Level II for all STAAR end-of-course subjects, although the district 
showed increases in Algebra | and Biology by 5 percentage points. 

For 2013 and 2014, the state outperformed the district for the percentage of students that met the 
Advanced level standard for all STAAR end-of-course subjects. 


Survey Feedback 


When comparing survey results over the last nine years, there was an overall decrease in the percent 
of respondents who were in favor or somewhat in favor of the concept of teacher performance pay 
from 69.2 percent in December 2007 to 49.7 percent in December 2014. 

Over the same time period, the percentage of respondents that indicated they were opposed or 
somewhat opposed to the ASPIRE Award model for that year, decreased from 39.2 percent to 28.1 
percent. 

Out of a total of 4,031 respondents on the December 2014 survey, 1,724 or 42.8 percent of the 
respondents provided at least one response for recommending changes to the 2013-2014 ASPIRE 
Award, whereas 57.2 percent of respondents did not provide any recommendations for changing the 
model. The top seven emergent categories reflected 65.2 percent of the responses. The response 
rate is fairly low and the results, while informative, may not be generalized to the population. 


Distribution of Highly Effective Teachers across the District 


For 2014, when looking at the distribution of highly effective teachers based on the Cumulative 
Composite Teacher Gain Index (TGI) (value-added score) and school poverty, there was a higher 
proportion of highly effective language arts, reading, mathematics, science, and social studies 
teachers in lowest poverty schools (4"" quartile) than in highest poverty schools (1° quartile). 

For 2014, there was a lower proportion of Well Below Average language arts, reading, mathematics, 
science, and social studies teachers in the lower poverty schools (4"" quartile) than higher poverty 
schools (1°' quartile). 


Administrative Response 
The district continues to use the information from the ASPIRE Award program evaluation and the ASPIRE 
Award survey to make annual improvements to the ASPIRE Award model. 
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Introduction 


The Houston Independent School District (HISD) had a system of performance pay based on objective 
indicators since 1997-1998. Initially, performance pay was only offered to the Superintendent of Schools; 
however, in 2000—2001, it expanded to include teachers. These early performance pay models were based 
on accountability ratings and overall campus performance and did not take into account demographic 
considerations. Moreover, the performance pay ranged from $450 to $1,000 per teacher. Since performance 
pay was awarded based on campus performance, individual teacher performance was not taken into account. 
There was a move to focus on student performance results, particularly growth in student learning. In January 
2006, the Houston Independent School District Board of Education approved a teacher performance-pay 
program designed to reward teachers based on both school performance and individual teacher performance 
that would include all teachers and make the awards more financially meaningful. 


2013-2014 ASPIRE Award Model 

There have been minor changes to the 2013-2014 ASPIRE Award Model. The model continues to be 
organized into three components: Individual Performance, Group Performance: Teachers, and Group 
Performance: Campus-Wide. The employees are placed into groups that are numbered (Groups 1-7, and 
1L/2L) rather than categories that were lettered. The naming convention was changed in 2012-2013 to 
reduce confusion, and those changes are still in effect. A full description of each of the groups can be found 
in the Program and Eligibility Requirements document (Appendix C); and a summary is listed below: 


Group 1: Core Foundation Teachers, Grades 3-10, With a Value-Added Report: To be considered in this 
group, employees must teach at least one and as many as five core foundation subjects for which a value- 
added report is generated. Student linkages are required to be provided during the spring linkage process in 
order for a teacher to be considered in this category. A teacher-level value-added report must be produced 
in order to be considered in this group. 


Group 2. Core Foundation Teachers, Pre-Kindergarten through Grade 2: To be considered in this group, 
employees must qualify as core foundation instructional staff and teach core foundation subjects to students 
in pre-kindergarten through grade 2 for the majority of the school day. Student linkages for students in grades 
1-2 are required to be provided during the spring linkage process in order for a teacher to be considered in 
this category. 


Group 3. Core Foundation Teachers, Grades 3-12, without EVAAS™ Value-Added Report: To be 
considered in this group, employees must qualify as core foundation teachers. Core foundation courses must 
be taught the majority of the school day. For a complete list of these courses, please review the master course 
list with ASPIRE core foundation subjects. This group may include special education teachers who teach core 
foundation courses where a value-added report cannot be generated, high school teachers of students in 
grades and subjects for which a value-added report cannot be generated, or teachers of low class sizes. 
Student linkages for students in grades 3-11 are required to be provided during the spring linkage process 
in order for a teacher to be considered in this category. 


Group 4. Elective/Ancillary Teachers: To be considered in this group, employees must teach 
elective/ancillary classes for the majority of the school day/year. 


Group 5. Instructional Support Staff: Instructional support-staff members are degreed, certified or licensed 
professionals assigned to a campus and provide direct support to the instruction of students. If the 
instructional support-staff member is assigned to multiple campuses, the percentage of assignment to a single 
campus cannot be less than 40%. Instructional support staff must have a campus ID as their department ID. 
Instructional support staff may link students and receive a value-added report, but the production of a value- 
added report does not place an employee as a core foundation teacher for the purposes of determining 
ASPIRE Award groups. 


Group 6. Teaching Assistants: Teaching assistants are staff members who have a job classification of 
“Teaching Assistant” and provide direct classroom instructional support to instructional staff. 


Group 7. Operational Support Staff: Operational support-staff members are campus-based employees who 
do not meet the requirements for instructional staff, instructional support staff, or teaching assistants. 
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Group 1L. Principals: To be considered in this group, employees must meet all general eligibility 
requirements and be the “principal of record” according to HR and PeopleSoft. 


Group 2L. Assistant Principals/Deans of Instruction/Deans of Students: To be considered in this group, 
employees must meet all eligibility requirements and be coded as an assistant principal, dean of instruction, 
or dean of students according to HR and PeopleSoft. 


Updates/Changes to Eligibility Criteria 
For the 2013-2014 award year, there has been one change in the eligibility document. 
e For Principals to be eligibile, all teacher positions at the campus must be fully staffed as of the first 
day of school, August 26, 2013. Principals of campuses who have teaching vacancies as of the first 
day of school can appeal their eligibility status. 


Awards for Staff in Groups 1-7 
A detailed description and graphic presentation of the 2013-2014 ASPIRE Award Model is provided in 
Appendix D. A summary of the award components is presented below. 


Individual Performance 
e Individual Performance (Group 1): The EVAAS™ Teacher Composite Cumulative Gain Index is 
used to calculate this award. Teachers with a composite cumulative gain index of 2.00 or higher are 
awarded $10,000. Teachers with a composite cumulative index of 1.00—-1.99 are awarded $5,000. 
Teachers with a composite cumulative gain index of -2.00 or less are not eligible to receive any other 
part of the ASPIRE award. 


Group Performance for Teachers 
e Group Performance for Teachers in Group 2: Campus-level 2" grade Comparative Growth for 


math and for reading are calculated and rank-ordered with all other campuses. Teachers in Group 2 
at campuses ranked in Quintile 1 are awarded $1,750 per subject. 

e Group Performance for Teachers in Group 3: The EVAAS™ department Cumulative Gain Index 
(CGI) for each subject is rank ordered with all other campuses of the same level (i.e. elementary 
campuses with other elementary campuses). Teachers in Group 3 at campuses ranked in Quintile 1 
are awarded a total of $3,500. For teachers who teach one subject, the award would be $3,500 for 
that subject; for teachers who teach two subjects, the award would be $1,750 per subject; for three 
subjects, the award would be $1,167 per subject; for four subjects, the award would be $875 per 
subject; and for teachers who teach 5 subjects, the award would be $700 per subject. 


Group Performance Campus Wide 
e Group Performance Campus-Wide Value-Added: This award is available to staff in all groups 


(Group 1—7) at varying award amounts. The EVAAS™ Campus Composite Cumulative Gain Index 
is rank-ordered with all other campuses of the same level (i.e. elementary campuses with other 
elementary campuses). Staff at campuses ranked in Quintile 1 are awarded. 

e Group Performance Campus-Wide Achievement or Growth: 

o Staff at elementary and middle school campuses are awarded using the 
Stanford/Aprenda Math and Reading indicators where the percent of students at or above 
the 50" percentile rank across all grades is calculated. Staff at campuses where 85 percent 
of students are at or above the 50" percentile on Stanford/Aprenda math or reading are 
awarded. Staff at campuses that do not meet this threshold may also be awarded if the 
campus is in Quintile 1 for growth. This award is available for staff Groups 1-6. 
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Staff at high school campuses are awarded using the AP/IB Participation and Performance 
indicator, where the number of students scoring 3 (AP exam) or 4 (IB exam) or higher is 
divided by the number of students enrolled in grades 10—12 for schools with an AP program 
and grades 11-12 in schools with an IB program. Staff at campuses in Quintile 1 are 
awarded. Awarding the top Quintile reflects a change from the 2012-2013 model where 
campuses had been rewarded with 40 percent or more of students meeting the threshold. 
This change expanded the number of campuses that received an award. Staff at campuses 
that do not meet this threshold may also be awarded if the campus is in Quintile 1 for growth. 
This award is available for staff in Groups 1-6. 


Awards for Staff in Groups 1L and 2L 

Group Performance 

Group Performance Campus-Wide Value-Added: This award is available to campus leaders in 
both groups, at varying award amounts. The EVAAS™ Campus Composite Cumulative Gain Index 
is rank-ordered with all other campuses of the same level (i.e. elementary campuses with other 
elementary campuses). Leaders at campuses ranked in Quintile 1 are awarded. 

Group Performance Campus-Wide Achievement or Growth: 


Oo 


Leaders at elementary and middle school campuses are awarded using the 
Stanford/Aprenda math and reading indicators, where the percent of students at or above 
the 50" percentile rank across all grades is calculated. Leaders at campuses where 85 
percent of students are at or above the 50" percentile on Stanford/Aprenda math or 
Stanford/Aprenda reading are awarded. Leaders at campuses that do not meet this threshold 
may also be awarded if the campus is in Quintile 1 for growth. 

Leaders at high school campuses are awarded using the AP/IB Participation and 
Performance indicator, where the number of students scoring 3 (AP exam) or 4 (IB exam) or 
higher is divided by the number of students enrolled in grades 10-12 at AP campuses and 
11-12 at IB campuses. Leaders at campuses in Quintile 1 are awarded. Leaders at 
campuses that do not meet this threshold may also be awarded if the campus is in Quintile 
1 for growth. This reflects a change since 2012-2013 where campuses leaders had been 
rewarded at campuses with 40 percent or more of students meeting the threshold. By 
changing it to Quintile 1, it expanded the number of high schools that received an award. 
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Methods 
Data Collection and Analysis 
e Quantitative and qualitative data were collected from a variety of sources, including program 
documentation, teacher value-added data, teacher recruitment and retention data, ASPIRE survey 
data, ASPIRE Learn survey results, ASPIRE Award payout files, professional development data files, 
and student performance data files. Basic descriptive statistics were employed to analyze the data. 
Appendix B, pp.53—56 summarizes the methods used in detail. 
e = The eligibility requirements, methods of analysis for the teachers and campus-based staff, special 
analysis for teachers, methods of analysis for the deans, assistant principals, and principals, and 
model amendments are outlined in the following appendices, respectively: Appendix C, pp. 57-61; 
Appendix D, pp. 62-68; Appendix E, pp. 69—72; and Appendix F, pp. 73-75. 
Survey Participants 
e Over the past eight years, the response rate increased from 11.4 percent for the December 2007 
administration to a peak of 50.8 for the May 2009 administration, then declined to 22.0 percent for 
the December 2014 administration (Table 1, p. 34). 
e If survey participants were employed by HISD during the 2013-2014 school year, they were asked 
to indicate their eligibility status and categorization, for which 2,972 of the 4,031 respondents in 2013- 
2014 indicated their eligibility status and ASPIRE Award categorization (see Table 2, p. 34). 
Data Limitations 
e For adetailed description of the limitations in the following changes in the structure of the ASPIRE 
Award survey, teacher attendance, teacher recruitment and teacher retention, and TEA 
Accountability, see Appendix B, p. 56. 


Results 


How many participants received an award, and how much money was awarded districtwide for the 
2013-2014 ASPIRE Award? How does this compare over the past eight years? 

e Since the inception of a performance-pay program, the district has paid out $249,311,622.82. There 
was an increase of $3,840,631.83 from 2012-2013 to 2013-2014 due to changes in eligibility and 
award model calculations (Table 5, p. 35). 

e When comparing the total payout from the 2005-2006 Teacher Performance-Pay Model to the 2006— 
2007 newly designed ASPIRE Award, the payout increased from $17,007,023.31 to $24,653,724.71 
in 2006-2007 (Table 3, p. 34). 

e Over the past eight years, the annual payout has ranged from $17.7 million in 2011-2012 to $42.5 
million in 2009-2010 with a $21 million payout for the 2013-2014 ASPIRE Award, reflecting 
budgetary and model changes (Tables 3—4, pp. 34—35). 

e The number of staff receiving an award decreased from 13,157 in 2006-2007, or 77.6 percent of 
eligible staff, to 5,772 in 2013-2014, or 50.7 percent of eligible staff, reflecting budgetary and model 
changes (Tables 3-14, pp. 34—40). 

e Figures 1-5 below provide a summary of the percent of core (Categories A-E/Groups 1-3) and all 
teachers (Categories A-F/Groups 1-4) that were eligible or considered for the ASPIRE Award 
program and the percent that were paid an ASPIRE Award, as well as the average payout for core 
and all teachers and the number of teachers paid an award from 2012-2013 to 2013-2014 (see pp. 
60-62 for description of employee categories for award purposes). Only the last two years are 
compared due to changes in budget and model design from earlier years. 

e When comparing the percentage of core teachers that were eligible to participate in ASPIRE Awards 
from 2012-2013 to 2013-2014, there was an increase of 4.4 percentage points, from 64.2 percent 
in 2012-2013 to 68.6 percent in 2013-2014. There was also an increase of all teachers that were 
eligible to participate in ASPIRE Awards from 64.8 percent in 2012-2013 to 65.6 percent in 2013- 
2014 (Figure 1, p. 8). 
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Figure 1. Percent of core teachers (Categories A-E/Groups 1-3) and all teachers (Categories 
A-E/Group 1-4) that were eligible to receive an ASPIRE Award, 2012-2013 to 2013-2014 
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e Figure 2 summarizes the percent of eligible core teachers and all teachers that were paid an ASPIRE 
Award for 2012-2013 to 2013-2014. The same percentage of core teachers received an ASPIRE 
Award over the past two years. When comparing all teachers, there was an increase in the 
percentage of all teachers that were paid by 1.3 percentage points. 


Figure 2. Percent of eligible core teachers (Categories A-E/Groups 1-3) and all teachers (Categories 
A-F/Groups 1-4) that were paid an ASPIRE Award for 2012-2013 to 2013-2014 
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e Figure 3 (p. 9) summarizes the percent of all considered core teachers and all teachers from 2012— 
2013 to 2013-2014. "Considered" refers to employees who were in a position included in the award 
model at some point during the year, but may or may not have met the program requirements for 
eligibility. There was an increase in the percentage of core teachers that received an ASPIRE Award 
from 2012-2013 to 2013-2014 by 2.6 percentage points, and an increase in the percentage of all 
teachers that received an ASPIRE Award from 2012-2013 to 2013-2014 by 3.3 percentage points. 
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Figure 3. Percent of all considered core teachers (Categories A-E/Groups 1-3) and all 
teachers (Categories A-F/Groups 1-4) that were paid an ASPIRE Award for 2012-2013 to 
2013-2014 
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e Figure 4 summarizes the average payout, rounded to the nearest dollar, for core teachers and all 
teachers. For core teachers, the average payout decreased by $386 from $4,458 in 2012-2013 to 
$4,072 in 2013-2014. Similarly, there was a decrease in the average payout for all teachers by $493 
from 2012-2013 to 2013-2014. 


Figure 4. Average payout for core teachers (Categories A-E/Groups 1-3) and all teachers 
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e Figure 5 summarizes the number of core teachers (Groups 1-3) and all teachers (Groups 1-4) that 
received an ASPIRE Award from 2012-2013 to 2013-2014. For core teachers, the number of 
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teachers receiving an award increased from 3,449 teachers for 2012—2013 to 3,768 in 2013-2014. 
For all teachers, there was an increase of 457 teachers 2012-2013 to 2013-2014. 


Figure 5. Number of core teachers (Groups 1-3) and all teachers 
(Groups 1-4) paid an ASPIRE Award, 2012-2013 to 2013-2014 
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e Figure 6 summarizes the percent of eligible employees (Groups 1—7) and all considered employees 
(Groups 1—7) that received an ASPIRE Award from 2012-2013 to 2013-2014. For eligible staff, the 
percent receiving an award increased from 49.7 percent in 2012—2013 to 50.7 percent in 2013-2014. 
For all considered employees, there was an increase in award recipients from 29.4 percent in 2012- 
2013 to 32.0 percent in 2013-2014. 


Figure 6. Percent of eligible staff (Groups 1-7, 1L, & 2L) and all considered staff (Groups 1- 
7, 1L & 2L) paid an ASPIRE Award, 2012-2013 to 2013-2014 
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Were there any common characteristics among the instructional staff that received an ASPIRE Award 
over the past two years? 


For both 2012-2013 and 2013-2014, the typical award recipient was female and held a Bachelor’s 
degree (Table 15, p. 41). 

For 2013-2014, disparities exist when looking at race/ethnicity, gender and years of experience 
(beginning teachers, teachers with 1 to 5 years of experience and teachers with 11 to 20 years of 
experience). The proportion of teachers who received an award who were White or Hispanic was 3.9 
and 3.0 percentage points higher compared to the district population. Whereas the percentage of 
teachers who received an award who were African American was 8.1 percentage points lower than 
the district population (Table 15, p. 41). 


Has the program helped the district to recruit and retain teachers, especially effective teachers 
providing instruction to high-need campuses, grade levels, and/or subject areas? 


Of the 607 core foundation teachers receiving a recruitment incentive and/or stipend (critical shortage 
stipend, bilingual stipend, strategic staffing stipend, or recruitment stipend) for whom individual award 
data were available (Group 1), 312 employees, or 51.4 percent, received both a Group 1/Strand 2 
teacher progress award, reflecting highly effective teachers, as well as a recruitment bonus. Out of 
2,202 core foundation teachers with individual data (Group 1) who did not receive a recruitment 
bonus, 1,014 employees, or 46.0 percent, received an individual performance Group 1/Strand 2 
award, but no recruitment bonus. However, not all of the teachers may have been eligible to receive 
a recruitment/retention bonus (Figure 7, p.12 and Table 16, p. 41). 

The percentage of employees receiving a recruitment incentive and/or stipend as well as a Strand 2 
teacher progress award has increased from 67.9 percent in 2007-2008 to 72.9 percent in 2009— 
2010, followed by a decline of 28.6 percentage points in 2012-2013, but increased by 7.1 percentage 
points in 2013-2014 (Figure 7, p.12). Table 16 on p. 41 describes the 2013-2014 incentive amounts 
of core teachers who received recruitment incentives. Changes over time may be attributed to factors 
other than the ASPIRE award such as implementing more refined recruitment and retention 
strategies. 

Over the past seven years, the percent of core teachers receiving a recruitment incentive and/or 
stipend but not a Strand 2 teacher progress award overall has increased from 32.1 percent in 2007— 
2008 to 48.6 percent in 2013-2014; however, there was a decline of 7.1 percentage points from 
2012-2013 to 2013-2014 (Figure 7, p.12). 

Over the past seven years, the percent of core teachers receiving an ASPIRE Strand 2/Group 1 
Award, reflecting a highly effective teacher, but no recruitment incentive has fluctuated over time 
decreasing from 68.5 percent in 2007-2008 to 60.8 percent in 2009-2010, and then increasing to 
68.2 percent in 2010-2011 followed by a decrease to 37.5 percent in 2012—2013 and then increasing 
to 46.0 percent in 2013-2014 (Figure 7, p.12). This may suggest that recruitment and retention 
strategies need to be examined more closely. 
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Figure 7. Percent of core teachers with individual data (Categories A and B/Group 1) receiving 
recruitment incentives and Strand 2/Group 1 ASPIRE Awards recipient status, 2007-2008 to 2013- 
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e The percentage of teachers in hard-to-staff schools receiving bonuses related to classroom level 
performance declined by 45.5 percentage points from 67.7 percent for the 2005-2006 cohort to 22.2 
percent for the 2013-2014 cohort, although this reflects an increase of 2.5 percentage points from 
the previous year (Figure 8, p. 13). Due to changes in the award model through time, fewer teachers 
received an award for individual performance. Additionally due to changes in the state accountability 
system, schools identified as hard-to-staff have changed over time. 
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Figure 8. Percent of teachers in hard-to-staff schools earning a Strand 2/Group 1 award 
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Note: Eligible core teacher and earned Teacher Performance-Pay based on their own value-added data in schools that 
missed AYP or were TEA-rated “Unacceptable” in the previous year for 2005—2006 to 2011-2012. For 2012-2013 and 
2013-2014, hard-to-staff schools refer to those schools that were TEA-rated as Improvement Required (IR). 


e Classroom retention rates for teachers were 88.6 percent in 2007-2008, rose to 90.9 percent in 
2008-2009, and then declined to 79.5 percent in 2013-2014 (Table 17, p. 42, and Figure 9). 

e For the 2010-2011 school year, budgetary cuts were responsible for the loss of teaching and other 
campus-based positions. 


Figure 9. Classroom retention, 2007-2008 to 2013-2014 
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e The percentage of core teachers that were retained in the classroom and received a Group 1/Strand 
2 award for teacher progress increased overall from 61.9 percent in 2008-2009 to 62.1 percent in 
2010-2011 and then declined to 34.6 percent in 2012—2013, followed by an increase to 40.8 percent 
in 2013-2014. These percentages reflect changes in the model (Figure 10 and Table 18, p. 42). 


Figure 10. Eligible core teachers and group 1/strand 2 award recipient status, 
2008-2009 to 2013-2014 
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e For core teachers that were retained in the classroom and did not receive a Group 1/Strand 2 award, 
there was an overall increase from 31.2 percent in 2008-2009 to 51.7 percent in 2012-2013, marked 
by a decline to 45.5 percent in 2013-2014 (Figure 10 and Table 18, p.42). 

e For core teachers that were not retained in the classroom and received an ASPIRE award based on 
teacher progress, there was an increase overall from 4.1 percent in 2008-2009 to 7.9 percent in 
2011-2012, followed by a decline to 5.1 percent in 2012—2013, followed by an increase to 6.2 percent 
in 2013-2014 (Figure 10 and Table 18, p. 42). 

e Highly effective teachers are defined as those whose value-added scores are 2.00 or higher, and 
high needs schools were Texas Education Agency (TEA) rated as Improvement Required (IR). 
Figure 11 (p. 15) summarizes the percent of highly effective teachers by subject area in high 
needs/Improvement Required schools compared to those schools that were not. The subject area 
with the highest percentage of highly effective teachers is mathematics with 10.7 percent in 
Improvement Required campuses and 26.9 percent in campuses that are not designated as 
Improvement Required schools. Reading reflects the subject with the lowest percentage of highly 
effective teachers with 1.6 percent at Improvement Required schools and 10.3 percent at schools 
that are not designated as Improvement Required. 

e Figure 12 (p. 15) summarizes the percentage of highly effective teachers at high needs/IR schools 
that were retained and not retained in the classroom by subject. Of importance, all of the language 
and social studies teachers at these high needs schools that were highly effective stayed in the 
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classroom. Reading had the lowest retention with 80.0 percent of highly effective teachers retained 
in the classroom. For mathematics, 92.0 percent of teachers were retained, followed by 87.5 percent 
of science teachers were retained. There were only 44 schools that were identified as TEA-rated 
Improvement Required. 


Figure 11. Percent of highly effective teachers at TEA-rated Improvement Required (IR) schools by 
subject area, 2013-2014 
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Note: IR schools=TEA-rated as Improvement Required (IR). There were 44 out of 264 schools with this designation for 
the 2013-2014 school year. 


Source: EVAAS single-year value-added file, 2013-2014; highly effective defined as receiving a cumulative composite 
TGI>2.0. 


Figure 12. Percent of highly effective teachers retained at TEA-rated Improvement Required (IR) 
schools by subject area 
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Note: IR schools=TEA-rated as Improvement Required (IR). There were 44 out of 264 schools with this designation for 
the 2013-2014 school year. Charter schools are not included. 


Source: EVAAS single-year value-added file, 2013-2014; highly effective defined as receiving a cumulative composite 
TGI>2.0. 


Have there been any changes in teacher attendance since performance-pay has been implemented? 


e Teacher attendance rates, using only requested absences, increased from 94.8 percent in 2004— 
2005 (before performance-pay) to 98.5 percent in 2009-2010 (performance-pay year 5), but declined 
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to 95.3 in 2013-2014 (Figure 13). This decline may be attributed to the elimination of the attendance 
bonus in 2010-2011. The attendance rates are based on the year of program implementation, while 
payout occurs in January or February of the following year. 


Figure 13. Teacher attendance rates, 2004—2005 (Baseline) to 2013-2014 (Year 9) 
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e Attendance rates for performance-pay recipients slightly exceeded overall district attendance rates 
from 2005-2006 to 2013-2014, with the largest difference visible in 2010-2011 and 2013-2014 with 
1.1 percentage points (Figure 14). 


Figure 14. Teacher attendance rates for performance-pay recipients, 2005-2006 to 2013-2014 
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What were the levels of completion for the ASPIRE training courses? 
e During the 2013-2014 school year, SAS EVAAS® rolled out a series of learning modules to help 
build capacity for understanding value-added data, the statistical models used to generate the data, 
and interpreting value-added reports (Table 19, p. 42). There were eight learning modules offered 
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during the 2013-2014 school year starting in October with a total of 2,048 teachers and administrators 
that completed at least one of the eight courses. 

The ASPIRE Portal housed online training through 15 courses and learning paths. The majority of 
courses centered on the different value-added reports, formative instructional practices, and the 
Value-Added Learning Paths. A total of 7,560 employees currently employed in HISD (duplicated 
report) completed at least one of the 15 courses or learning paths offered since the September 2008, 
when the courses were first offered (Table 20, p. 43). 

During the 2013-2014 school year, 130 employees completed ASPIRE professional development 
courses, and 19 employees completed learning paths Table 21 and Table 22, pp. 43-44). 


Has the implementation process been improved as measured by the number of formal inquiries 
submitted? 


There was a decrease in the number of formal inquiries submitted since the implementation of the 
ASPIRE Award program from 1,048 in 2006-2007 to 455 in 2009-2010, followed by an increase to 
856 for 2010-2011, and then a decline to 515 for 2011—2012, followed by an increase to 907 in 2013- 
2014. However, 2013-2014 marked a change in the implementation process for formal inquiries. 
There were two inquiry periods. The first covering eligibility and confirmation, and the second was 
the final inquiry period. For 2013-2014, 75.3 percent were resolved without changes in award amount 
(Table 23, p. 44). 


Have students shown academic gains in the four core content areas based on standardized test 
performance for 2005-2006 through 2013-2014? 


Districtwide student performance on the Stanford 10 showed increases in the NCE scores from 2010 
and 2014 in first and third grade mathematics, grade 4 language, grades 3, 4, 5, and 8 in science, 
and third and fifth grade social science. Alternatively, NCE decreases were evident for 7 out of 8 
grades in reading, with no change in third grade reading (Table 24, p. 44). 

From 2005 to 2014, districtwide student performance on the Aprenda 3 showed increases in reading, 
mathematics, language and environment/science for grades 1-4 and grade 8. Social science 
increased for 4 out six grade levels. The number of students tested drops dramatically for grades 5— 
8 (Tables 25-26, p. 45). 

Figure 15 (p. 18) shows the percent of district and state students who met the initial phase-in 
standard for Level Il (Satisfactory) by subject for spring 2013 and 2014. This figure includes the 
results from STAAR combined English and Spanish test versions. The highest percentage of HISD 
students met the phase-in standard for Level II in Reading/ELA and mathematics (70 percent and 69 
percent, respectively for reading and 67 percent and 69 percent for mathematics), while the lowest 
percentage of students was in social studies (57 percent and 54 percent). For both 2013 and 2014, 
the state outperformed the district in the percent of students that met the initial phase-in standard for 
Level Il (Tables 27-29, pp. 45-46). 

For 2013 and 2014 (Figure 16, p. 18), the state outperformed the district in the percent of students 
that met the Advanced Level with the exception of writing and mathematics, where both the district 
and the state had the same percent of students meeting the advanced standard, respectively. 
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Figure 15. HISD and state combined English and Spanish STAAR % Level II Satisfactory Phase- 
In standard, spring 2013 and 2014 


70 66 t1 69 


Percent Met Standard 


Reading/ELA Writing Math Science Social Studies 


State of Texas Assessments of Academic Readiness (STAAR) 
=™2013 State 2013 District =2014 State 2014 District 


Figure 16. HISD and state combined English and Spanish STAAR % at Level Ill Advanced, spring 
2013 and 2014 
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e For 2014 (Figure 17, p. 19), the state outperformed the district in the percent of students that met 
the phase-in standard for Satisfactory Level II for all STAAR end-of-course subjects. The district 
increased the percentage of students meeting Level II when comparing 2013 to 2014 for Algebra and 
Biology. It should be noted that the results for 2013 and 2014 include first-time testers only. In 2013, 
the state did not split out first-time testers from re-testers. 

e For 2014 (Figure 18, p. 19), the state outperformed the district for the percentage of students that 
met the Advanced level standard for all STAAR end-of-course subjects. District results increased for 
the percent of students meeting the Advanced Level standard on the Algebra end-of-course exam 
from 15 percent in 2013 to 19 percent in 2014. 
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Figure 17. HISD and state comparison of STAAR End-of-Course exams, meeting Satisfactory Phase- 
In standard, spring 2013 and 2014 
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Note: Results reflect first-time testers only. In 2013, the state did not split out first-time testers from re-testers. 


Figure 18. HISD and state comparison of STAAR End-of-Course Exams, Advanced Level, spring 
2013 and 2014 
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Note: Results reflect first-time testers only. In 2013, the state did not split out first-time testers from re-testers. 


Based upon survey results, what were the perceptions of respondents regarding the 2013-2014 

ASPIRE Award? How does this compare to previous years? 

e Survey invitations were sent to a total of 18,364 Houston Independent School District campus-based 
employees on December 3, 2014 with 4,031 participants who responded to the survey (22.0 percent) 
(Table 1, p. 34). Any conclusions drawn from this survey should be made with caution given the low 
response rate (See Data Limitations, p. 56). 
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e Of the 4,031 respondents, 2,972 indicated their ASPIRE Award categorization for the 2013-2014 school 
year. Core teachers (Group 1, 2, and 3) represented the highest percentage of respondents with 58.1 
percent, followed by elective/ancillary teachers with 12.0 percent (Table 2, p. 35). 

e Of the 1,513 December 2007 survey respondents, 65.6 percent indicated that they received an award. 
The percentage continued to increase through the March 2011 survey, where 90.3 percent of 
respondents received an award. There was a decline of 10.2 percentage points from March 2011 to 
March 2012, with a 25.3 percentage point decline from March 2012 to January 2014, followed by an 
increase of 4.1 percentage points in December 2014 (Figure 19). These survey trends are reflective of 
the award payout percentages as well. 

e Figure 19 summarizes the percent of survey respondents that reported receiving an award by program 
year. The majority of respondents received an ASPIRE award. 


Figure 19. Percent of respondents receiving an award based on results of nine survey 
administrations 
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e When comparing survey results over the last nine years, there was an overall decrease in the percent of 
respondents who were in favor or somewhat in favor of the concept of teacher performance pay from 
69.2 percent in December 2007 to 49.7 percent in December 2014 (Figure 20). 


Figure 20. Percent of respondents indicating favorability toward the concept of performance pay over 
nine years 
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e Figure 21 summarizes the perceptions of respondents towards the respective performance-pay 
models through time. When comparing the percentage of respondents that indicated they were in 
favor or somewhat in favor toward the 2005-2006 Teacher-Performance Pay Model and to the 
specific ASPIRE Award program for that year, it was first reported at 44.4 percent (December 2007 
survey administration), reached a peak of 53.3 percent in 2009, and was most recently reported at 
39.5 percent (December 2014 survey administration). These results were after the payout of each 
model, or in the most recent survey administration, prior to the payout. 

e When comparing survey results after or just prior to each payout, the percentage of respondents that 
indicated they were somewhat opposed or opposed toward the 2005-2006 Teacher Performance- 
Pay Model and to the 2013-2014 ASPIRE Award program decreased by 11.1 percentage points over 
a nine-year period, with the low being in 2009 at 24.0 percent (Figure 21). 


Figure 21. Percent of survey respondents’ favorability toward the performance-pay model paid out 
that year 
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e Over the past seven years, survey respondents were asked to indicate their perceptions about the 
concept of receiving differentiated pay as seen in Figure 22. The percentage of campus-based staff 
in favor or somewhat in favor of the concept of differentiated pay decreased overall from 55.5 percent 
after the 2009 payout to 48.1 percent in December 2014, prior to the 2015 payout (Figure 22, p. 22). 

e When comparing survey results from May 2008 to December 2014, the percentage of respondents 
that indicated their level of understanding of the ASPIRE Award program was very low or low, 
increased by 8.7 percentage points, and there was a decrease in the percentage of respondents that 
indicated their level of understanding of the ASPIRE Award program was sufficient (10.1 percentage 
points) (Figure 23, p. 22). 
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Figure 22. Percent of respondents indicating favorability toward the concept of differentiated 
pay for the past seven years 
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Figure 23. Percent of survey respondents’ level of understanding of the performance-pay model 
paid out that year 
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e Figure 24 (p. 23) provides a comparison of the percent of respondents who watched at least one 
Value-Added/EVAAS Learning Module in the past 12 months. Out of 3,197 respondents, 31.1 
indicated Yes, 40.9 percent responded No, and 28.0 percent indicated that they did not know this 
resource was available. 
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Figure 24. Percent of survey respondents watching value-added learning modules 
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e On the May 2008 ASPIRE Award survey, there were seven items that were designed to determine 
the level of understanding for different training components related to the ASPIRE Award. Table 30 
(p. 46) depicts the comparison of the baseline data collected in May 2008 with data collected in 
December 2014. 

e The percentage of respondents indicating a high/very high level of understanding decreased for six 
of the seven components. However, December 2014 had a lower number of respondents compared 
to 2008 (Table 30, p. 46). 

e Based on survey data collected in May 2008 and December 2014, the training component for which 
the largest percentage of respondents indicated, in both years, a very high or high level of 
understanding centered on my understanding of the difference between student achievement and 
academic progress (44.5 and 38.7 percent, respectively) (Table 30, p. 46). 

e Based on survey data collected in May 2008 and December 2014, the training component for which 
the largest percentage of respondents indicated, in both years, a very low or /ow level of 
understanding focused on how the ASPIRE Awards were calculated/determined (33.9 percent and 
44.1 percent, respectively) (Table 30, p. 46). 

e On the 2010 and 2014 survey administrations, the statement for which the largest percentage of 
respondents indicated strongly agree or agree centered on continuing the ASPIRE Award and 
modifying the model on an annual basis (48.7 percent and 54.2 percent, respectively) (Table 31, p. 
47). 


Based upon survey results, what was the level of effectiveness for communicating information 
about the ASPIRE Award? 

e When comparing results from baseline to December 2014, nine of the ten areas of communication 
showed decreases. Knowing when specific information about my ASPIRE Award was available 
reflected the area of communication for which respondents indicated the highest increase for 
effectiveness (0.8 percentage point) (Table 32, p. 48). 

e Based on the December 2014 surveys, the areas for which the highest percentage of respondents 
perceived communications to be not effective or somewhat effective focused on providing clear 
explanations about comparative growth calculations (53.6 percent), providing clear explanations 
about value-added calculations (54.5 percent) and providing clear explanations about the award 
model (49.0 percent)(Table 32, p. 48). 

e Based on the results of the December 2014 survey, 86.7 percent of respondents reported the 
ASPIRE e-mail as reflecting the highest percentage when compared to the other four methods used 
to communicate information about the ASPIRE Award program. This was followed by the ASPIRE 
eNEWS (69.9 percent) (Table 33, p. 48). 
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Based upon survey results, what recommendations were made to incorporate changes to the ASPIRE 
Award? 

e Out of a total of 4,031 respondents on the December 2014 survey, 1,724 or 42.8 percent of the 
respondents provided at least one response for recommending changes to the 2013-2014 ASPIRE 
Award, whereas 57.2 percent of respondents did not provide any responses. Table 34 (p. 49) 
summarizes the frequency and percent of responses. 

e A total of 3.1 percent and 4.4 percent of the 1,724 responses reflected that no changes were needed 
to the model or the response was simply, No Comment. The top six emergent categories reflected 
54.5 percent of the responses (Table 34, p. 49). 

e The predominant suggestion centered on making the model equitable, fair, transparent, inclusive, 
with clear expectations so that all employees were treated equally, compensated equally, and/or had 
the opportunity to receive the same amount of award as the top dollar earners (12.8 percent). 
Elective/ancillary teachers, special education teachers, early childhood through grade 2, instructional 
support (i.e. counselors, librarians, and literacy coach), teaching assistants, and operational support 
staff (i.e. registrars, computer network specialists, and attendance specialists) were not eligible to 
receive the same level of compensation as core teachers with an EVAAS report. They felt “de-valued” 
by the way the model was designed. Some respondents indicated that the differences in eligibility 
and compensation were divisive for campuses. Moreover, respondents indicated that student 
success was a team effort, but the contribution of the team was not being equally valued for all 
members (Table 34, p. 49). 

e Unintended consequences (divisive, cheating, free-riding) comprised about 12.0 percent of reponses. 
Respondents felt that some teachers would benefit from the award program but did not contribute 
significantly to student growth (free-riding). Another respondent indicated that “cheating is 
widespread in the HISD district...”, while another indicated that “The ASPIRE Award Program, as is, 
is not a fair way to compensate and reward those teachers who are effective in non-tested subjects.” 
Another respondent stated, “The very best teachers are leaving HISD for more competitive salaries 
and stipends.” Others have stated that it is “divisive”, and breeds frustration and confusion (Table 34, 
p. 49).” 

e Approximately 11.0 percent of the responses focused on the allocation of money. Respondents 
indicated that the money should be reallocated for student scholarships, smaller classes, better 
equipment, more tutors, school materials for students, clothes for students, attendance incentives for 
students, and to increase the base pay. Some respondents indicated that STAAR teachers or 
teachers in tested grade levels, teachers working in hard-to-staff schools and teachers providing 
instruction to low-income students and/or at-risk students should receive more money. Alternatively, 
respondents indicated that elective/ancillary teachers, special education teachers, Career and 
Technology teachers, librarians, nurses, early childhood teachers to grade 2 teachers (Group 2) 
should receive more money. Some respondents indicated that administrators should not receive any 
performance-pay money, their performance pay should be capped, or indicated that payouts for 
administrators were disproportionate in comparison to payouts for teachers. One respondent stated, 
“Making it more fair school wide for teachers. Central Office adminlistration] (including 
superintendent) should not be a part of ASPIRE” (Table 34, p. 49). 

e A total of 174 responses or 6.9 percent of respondents were concerned about external factors that 
they perceived as impacting growth or the calcuation of growth. These were factors that teachers 
perceived as being out of their immedate control such as the classrooom composition (high numbers 
of behavior problems, English Language Learners, at-risk, high performing, etc.). Another factor 
centered on the time scheduled for a course. If students had more hours for reading and mathematics 
and less for science or art, how can they be compared? A third factor included those teachers who 
had tutors for their classes. Is it fair to calculate value-added scores for teachers with tutors and 
teachers who had no tutors. Student apathy and absenteeism were also factors that were out of a 
teacher’s control (Table 34, p.49). 

e Six percent of the respondents wanted to have the same earning opportunity as a core teacher with 
EVAAS®, or stated that their maximum award wasn’t commensurate with their professional 
contribution (Table 34, p. 49). 
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e A total of 140 responses, or 5.5 percent of respondents to this question indicated that the ASPIRE 
Award should be discontinued. One respondent cited, “Discontinue the program and use the ASPIRE 
money for scholarships for high achieving students to go to college." Another respondent stated, 
“Eliminate the program to restore true collaboration and teamwork” (Table 34, p. 49). 


How are highly effective teachers based on value-added analysis by subject distributed in schools 
across the district based on school poverty? 

e Toexamine the distribution of effective teachers across the district, the cumulative composite teacher 
gain index (TGI) by subject was analyzed to see how highly effective teachers were distributed when 
examining schools with students in grades 3 through 8 and those taking end-of-course exams. Highly 
effective teachers earned value-added scores that were greater than or equal to 2.00, indicating the 
growth of their students was Well Above Average regarding the standard for academic growth. A TGI 
of less than -2.00 indicates Well Below Average than the standard for academic growth. Figure 24 
summarizes the cumulative composite teacher gain index for language reflecting single year results 
by the quartiled distribution of percent of campus poverty. For 2013-2014, the percentage of highly 
effective language arts teachers in lower poverty schools was higher than those in higher poverty 
schools (19.5 percent in the fourth quartile compared to 10.3 percent in the first quartile) (Table 35, 
p. 50). 

e Alternatively, there was a lower proportion of Well Below Average language arts teachers in the lower 
poverty schools than higher poverty schools. 

e Approximately 5.3 percent of language arts teachers in the lowest poverty (more affluent) schools 
were Well Below Average compared to 10.4 percent in the 3rd quartile of poverty, 13.2 percent in the 
second quartile of poverty, and 13.5 percent in the highest quartile of poverty (Figure 24, Table 35, 
p.50). 


Figure 24, Percentage of Teachers and Their Effectiveness Based on Language Arts Cumulative 
Composite TGI and School Poverty, 2013-2014 
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e For 2013-2014, 15.4 percent of reading teachers scored in the Above Average category in the 
lowest poverty (more affluent) schools compared to 5.2 percent in the 3rd quartile, 8.0 percent in 
the second quartile of poverty, and 6.2 percent in the highest poverty schools (Figure 25, p. 26, 
Table 36, p. 50). The percentage of teachers scoring in the Well Above Average category in the 
lowest poverty quartile was more than twice that in the highest poverty schools. 

e Only 5.8 percent of reading teachers in the lowest poverty (more affluent) schools were Well Below 
Average compared to 13.9 percent in the 3 quartile of poverty, 11.1 percent in the 2™ quartile of 
poverty, and 13.5 percent in the highest poverty schools, and the percent of Well Below Average 
teachers in the highest poverty quartile was over twice that of the lowest poverty quartile (Figure 25, 
Table 36, p. 50). 


Figure 25, Percentage of Teachers and Their Effectiveness Based on Reading Cumulative 
Composite TGI and School Poverty, 2013-2014 
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e Formathematics in 2013-2014, 28.8 percent of teachers scored in the Well Above Average category 
in the lowest poverty (more affluent) schools compared to 25.8 percent in the highest poverty schools 
indicating a more consistent distribution of math teachers across all levels of school poverty (Figure 
26, Table 37, p. 50). 

e For the lowest poverty schools, 15.6 percent of mathematics teachers were Well Below Average 
compared to 19.3 percent in the highest poverty schools (Figure 26, Table 37, p. 50). 
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Figure 26. Percentage of Teachers and Their Effectiveness Based on Mathematics Cumulative 
Composite TGI and School Poverty, 2013-2014 
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e =In 2013-2014, 27.1 percent of science teachers scored in the Well Above Average category in the 
lowest poverty (more affluent) schools compared to 13.2 percent in the highest poverty schools. 
There was a higher proportion of highly effective science teachers in lower poverty schools than 
higher poverty schools (Figure 27, Table 38, p. 51). 

e In the lowest poverty (more affluent) schools 13.7 percent of science teachers were Well Below 
Average compared to 15.4 percent in the highest poverty schools (Figure 27, Table 38, p. 51). 


Figure 27. Percentage of Teachers and Their Effectiveness Based on Science Cumulative 
Composite TGI and School Poverty, 2013-2014 


100% 
o 
| 14.4 | | 13.2 | 

: 80% ma 10.7 11.4 
Bi 0 i d 
2 _ 12.4 

oO 
=> 0, 
6 Ps 60% 
o + 
28 40% 
oo 
SE 
n 8 20% 
i 
o 
= 0% 
a 4th Quartile 3rd Quartile 2nd Quartile 1st Quartile 

(Lowest Poverty, (Highest Poverty 
Moreninhent) School Poverty Level Rae) 
= Well Below (< -2.00) = Below Average (-2.00 to -1.01) ™ Average (-1.00 to 0.99) 


Above Average (1.00 to 1.99) mWell Above Average (22.00) 


e For social studies in 2013-2014, 28.1 percent of teachers scored in the Well Above Average 
category in the lowest poverty (more affluent) schools compared to 15.6 percent in the 3rd quartile, 
15.5 in the second quartile of poverty, and 14.8 percent in the highest poverty schools. There was 
a higher proportion of highly effective social studies teachers in lower poverty schools than higher 
poverty schools. (Figure 28, p. 28, Table 39, p. 51). 


HISD Research and Accountability 27 


e In the lowest poverty (more affluent) schools, 11.5 percent of social studies teachers were Well 
Below Average compared to 23.0 percent in the 3 quartile of poverty, 19.3 percent in the 2" quartile 
of poverty, and 20.8 percent in the highest poverty schools. There was a lower proportion of Well 
Below Average social studies teachers in lower poverty schools than higher poverty schools. (Figure 
28, Table 39, p. 51). 


Figure 28. Percentage of Teachers and Their Effectiveness Based on Social Studies Cumulative 
Composite TGI and School Poverty, 2013-2014 
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Discussion 


Over the past nine years, the performance-pay evaluation results have varied over time, reflecting the 
effects of policy changes with model development, funding, and assessment indicators. These changes are 
evident as the ASPIRE Award outcome measures have changed in the following areas: award payout, 
recruitment and retention, teacher attendance, student academic performance, survey feedback, and 
distribution of highly effective teachers across the district. Positive indicators include: retention of highly 
effective staff at TEA-rated Improvement Required schools, percent of retained teachers receiving an 
individual performance award compared to the previous year, percent of core teachers receiving both an 
individual performance award and a recruitment incentive compared to the previous year, the percent of core 
teachers and all teachers receiving an award compared to the previous year, and the distribution of highly 
effective language arts, reading, mathematics, science, and social studies teachers across all levels of school 
poverty. Negative indicators include: longitudinal retention data for core teachers who were retained and 
received an individual performance award, percent of respondents indicating favorability toward the concept 
of performance pay and differentiated pay over time, and student performance results of the district compared 
to the state on the State of Texas Assessments of Academic Readiness (STAAR) assessments. 

Longitudinal results for teachers receiving performance pay and the total amount awarded has varied 
over time. The number of eligible teachers receiving performance pay and the total amount awarded 
increased from 2006-2007 to 2009-2010, and then declined when comparing results from 2009-2010 to 
2012-2013, followed by a modest increase of 4.4 percentage points in 2013-2014. This decrease, and 
subsequent increase reflects changes in program eligibility, funding, and assessment indicators. The typical 
award recipient was female and held a Bachelor’s degree; when comparing the award population to the 
district, race/ethnicity, gender, and years of experience for beginning teachers and teachers with 1 to 5 years 
of experience did not mirror the proportions of the district. A lower percentage of African American teachers, 
beginning teachers, and teachers with 1 to 5 years of experience received an award compared to the district. 
Future analysis to determine statistical significance of any differences may be necessary. 

Recruitment strategies included different types of recruitment bonuses for critical shortage areas such as 
science, mathematics, bilingual, and/or special education. In addition, stipends were paid to teachers offering 
instruction in the aforementioned areas. Of the 607 core foundation teachers that received a recruitment 
bonus or stipend in 2013-2014, a total of 286 teachers, or 51.4 percent received a teacher progress reward, 
reflecting a highly effective teacher. However, not all of these newly recruited teachers met the eligibility 
requirements to be considered for a teacher-level ASPIRE Award. 

When looking at the percent of teachers in hard-to-staff schools that earned an ASPIRE award for teacher 
progress, there was a decline from 67.7 percent in 2005—2006 to 19.7 percent in 2012-2013, followed by a 
slight increase to 22.2 percent for 2013-2014. When examining the percentage of highly effective teachers 
at TEA-rated Improvement Required (IR) schools by subject area, the lowest percentage was in reading with 
1.6 percent and the highest percentage was in mathematics with 10.7 percent. The low percentages are in 
part due to the fact that there were only 44 out of 264 schools that were designated as Improvement Required 
in 2013-2014. 

Classroom retention rates over the past seven years varied, with a high of 90.9 percent in 2008-2009 
and a low of 79.5 in 2013-2014. Classroom retention rates for core teachers that received a teacher progress 
award varied over the past six years with a high of 62.1 percent in 2010-2011 to a low of 34.6 percent in 
2012-2013; moreover, there was an increase in the percentage of core teachers that received a teacher 
progress award but were not retained from 4.1 percent in 2008-2009 to 6.2 percent in 2013-2014. This 
indicates a need to consider what other factors might be influencing effective teachers’ decisions to stay or 
leave the classroom, as through the annual survey administered in 2013-2014 discussed below. In addition, 
due to more rigorous criteria, fewer teachers earned a teacher progress award. 

Attendance rates for teachers remained at approximately 95 percent from 2004—2005 (Before 
Performance Pay) to 2008-2009, increased to 98.5 percent in 2009—2010 (Attendance Bonus awarded), and 
then declined to 95.3 percent in 2013-2014. Although attendance rates for teachers receiving an ASPIRE 
Award over the nine-year period were higher than the district's attendance rates, the differences did not 
exceed one percentage point with the exception of 2010—2011 and 2013-2014 (1.1 percentage points) and 
likely reflect the attendance requirement to receive an award. 

Implementation of the ASPIRE Award program has improved over the past eight years because of 
improved communications and professional development. For the 2013-2014 school year, professional 
development centered on learning modules to help build capacity for understanding value-added data, the 
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statistical models used to generate the data, and interpreting value-added reports. The district offered online 
training through 15 courses and learning paths on the ASPIRE portal. Value added and comparative growth 
were important topical areas as well as formative instructional practices. Although a lower number of 
employees completed professional development for the 2013-2014 school year, combined with those that 
completed training over the past eight years, the district is moving in a positive direction building educators 
knowledge and understanding of the ASPIRE program. 

The ASPIRE Award inquiry period allowed employees to raise questions about their ASPIRE eligibility 
and/or award estimates. Two inquiry periods were held instead of only one. The intent was to have an inquiry 
period solely for concerns about eligibility status first and another inquiry period solely for concerns about 
award calculation and summative ratings. The number of formal inquiries has varied over the years, but direct 
comparisons should be viewed with caution due to the change in implementation. 

With regard to student performance, data from norm-reference tests are characterized by mixed results 
in the core content areas when comparing Stanford 10 and Aprenda 3 (the Spanish version). Stanford results 
showed overall increases in environment/science and social science, no change in mathematics, and 
decreases in reading and language arts. Aprenda tended to show higher achievement in all subjects for 
grades one through four and grade 8 in 2014, with declines across all subjects for grade 5, and mixed results 
for grade 6 and 7. The number of test takers in grades 6 through 8 decreased dramatically as well from 6,397 
students in grade 1 to 6 students in grade 6. This may therefore reflect a very different population of Aprenda 
testers, possibly due to earlier advancement of students to Stanford in 2014 than in 2005. STAAR grades 3- 
8 results for 2013 and 2014 show that the state outperformed the district for the percent of students scoring 
at the Level II Satisfactory Phase-In Standard for all subjects. When comparing 2013 to 2014 state results for 
the percent of students scoring at the Level II Satisfactory Phase-In Standard, there was no change in reading, 
the percentage of students meeting the standard in writing and math increased, while the percentage of 
students meeting the standard for science and social studies decreased. The state outperformed the district 
for 2014 when looking at the percent of students that met the phase-in standard for Level II for all STAAR 
end-of-course subjects. 

Since the inception of a performance-pay program, the district has administered a survey to gain insight 
regarding the level of knowledge and perceptions of HISD teachers and staff regarding growth-based 
performance pay in HISD, as well as their perceptions regarding the overall concept of performance pay. This 
annual survey serves as a mechanism to gather valuable feedback from program participants, although the 
response rate remains fairly low. External factors, such as policy decisions, roll-out of a new model, or roll- 
out of new model components may have influenced perceptions of growth-based performance pay since its 
inception. 

There have been four key areas that have shown mixed results over the past four to eight years in the 
survey. First, when comparing the survey response rate for December 2007 to the response rate for 
December 2014, there was an overall increase from 11.4 percent to 22.0 percent, but a decrease of 3.7 
percentage points from January 2014. The response rate is low and caution is warranted in interpreting the 
data. 

A second key area, support for the program, showed mixed results over the eight-year period. Although 
the percentage of campus-based staff in favor or somewhat in favor of the concept of teacher performance 
pay decreased from 69.2 percent after the 2007 payout to 55.2 percent after the 2010 payout, this increased 
to 58.6 after the 2012 payout, but then decreased to 49.7 percent with the December 2014 survey 
administration. When respondents were asked about their perceptions of the award model for that year, 44.4 
percent of respondents were in favor or somewhat in favor of the 2005-2006 Teacher Performance-Pay 
Model (December 2007) compared to the peak of 53.3 percent who were in favor or somewhat in favor of the 
ASPIRE Award program in May 2009. Alternatively, the majority of respondents have not been in favor or 
somewhat in favor of the ASPIRE Award program over the past five years. 

A related measure, support for the concept of differentiated pay, also showed mixed results. Baseline 
data were collected during the May 2009 survey administration. Approximately 56.0 percent of respondents 
indicated they were in favor or somewhat in favor of differentiated pay in 2009, and this decreased to 48.3 
percent in March 2010, but increased to 50.9 percent in March 2011, followed by an increase to 53.0 percent 
in March 2012, but then decreased to 47.2 percent in March 2013, increased to 49.4 percent in January 2014, 
and was followed by a decrease to 48.1 percent in December 2014. 

The final key area centered on training sessions for value-added analysis. Historically, training courses 
have been offered on-line so that staff could complete the modules at their own pace. In 2013-2014, in 
addition to on-line training, face-to-face training sessions were held around the district, and live webinars 
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were offered to help teachers avoid travel and to be archived for future use. For the 2013-2014 school year, 
31.1 percent of respondents indicated that they watched at least one of the Learning Modules on the SAS 
EVAAS® site in the last twelve months. 

Collecting feedback about effective communications was undertaken over the past six years to identify 
areas for improvement as well as areas that were effective. Based on survey results from 2009 to 2014, there 
was a decrease in effectiveness in nine of the ten areas for which data were available, including the newly 
added items, providing clear explanations about the award model, providing clear explanations about value- 
added calculations, and providing clear explanations about comparative growth calculations. Based on 
December 2014 survey data, 53.6 percent of respondents indicated that communication was not effective or 
somewhat effective for providing clear explanations about comparative growth, 54.5 percent of respondents 
indicated that communications were not effective or somewhat effective for providing clear explanations about 
value-added calculations, and 49.0 percent of respondents indicated that providing clear explanations about 
the award model was not effective or somewhat effective. As value-added data and comparative growth data 
will now factor into all core teachers’ appraisals, clear communication as well as effective training concerning 
them is a priority. 

The survey administered after each payout has served as a vehicle for respondents to recommend 
changes to the current model. Feedback is particularly valued to improve the ASPIRE Award program. Input 
varied from comments such as: “Too many changes to keep up with. Not enough people to explain how it 
actually works;” “We need a clearer understanding of how EVAAS® Scores are calculated. There are too 
many misconceptions about the process;” “Divide the ASPIRE Award amount equally among all teachers at 
a school. We all teach the same students. It should not be an award based on a subject area. It should be 
comprehensive for all on the same campus;” and, “I would not change it.” 
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Table 1. Nine-Year Summary of Survey Response Rates by Pay for Performance Model 


Date of Survey # of Response 
Model and Year Administration Population Sample Respondents Rate 
2005-2006 TPPM December 2007 16,296 - 1,851 11.4 
2006-2007 ASPIRE Award May 2008 16,504 - 6,383 38.7 
2007-2008 ASPIRE Award May 2009 16,907 8,073 4,102 50.8 
2008-2009 ASPIRE Award March 2010 19,312 - 7,284 37.7 
2009-2010 ASPIRE Award March 2011 20,048 6,083 30.3 
2010-2011 ASPIRE Award March 2012 18,747 3,411 18.4 
2011-2012 ASPIRE Award March 2013 19,072 3,603 18.9 
2012-2013 ASPIRE Award January 2014 18,269 4,689 25.7 
2013-2014 ASPIRE Award | December 2014 18,364 4,031 22.0 


Table 2. Number and Percent of Survey Respondents by Categorization, 2013-2014 ASPIRE Award, 


December 2014 Survey Administrations 


2012-2013 2013-2014 

Category N % N % 

Group 1, Core Teacher Grades 3-10 WIEVAAS 1,062 31.2 881 29.6 
Group 2, Core Teacher PK—2 702 20.6 535 18.0 
Group 3, Core Teacher Grades 3-12 w/o EVAAS 283 8.3 312 10.5 
Group 4, Elective/Ancillary Teacher 375 11.0 356 12.0 
Group 5, Instructional Support 253 7.4 259 8.7 
Group 6, Teaching Assistant 252 7.4 236 7.9 
Group 7, Operational Support 282 8.3 249 8.4 
Group 1L, Principals 104 3.1 74 2.5 
Group 2L, Assistant Principals/Deans of Instruction 90 2.6 70 2.4 
Total 3,403 100.0 2,972 100.0 


Table 3. Strand Totals for All Paid Campus Employees, 2005-2006 to 2008-2009 


2005-2006 2006-2007 2007-2008 2008-2009 
Award Amount Award Amount Award Amount Award Amount 
Strand 1 Total $5,651,242.87 $5,785,445.13 $7,110,021.99 $9,292,437.65 
Strand 2 Total $6,935,282.42 $12,465,871.28  $15,164,006.27 $20,662,487 .64 
Strand 3 Total $2,950,820.00 $6,137,924.34 $9,043,512.82 $10,135,574.25 
Total Pre-Attendance $15,537,345.31 $24,389,240.75  $31,317,541.08 $40,090,499.54 
Attendance Bonus $189,679.00 $264,436.00 $264,162.38 $363,461.91 
Principal $1,279,999.00 - - $110,732.38 
Total Award $17,007,023.31 $24,653,724.71  $31,581,703.46 $40,564,693.83 


For 2005-2006, principal payout was not disaggregated by strand; the total payout is shown. For all other years, strand 
totals include all paid campus employees (Categories A through kK). 

*TIF money was paid to those meeting federal requirements of the grant. 

Note: For 2006-2007, the strand amounts and attendance bonus for instructional, non-core employees do not add up to 
the Total amount due to adjustments of $47.96. The Total Award amount of $24,653,724.71 does reflect the actual 
payout. 
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Table 4. Totals for all Paid Campus Employees, 2009-2010 to 2013-2014 


Campus Progress 
Component 

Core Foundation Teacher 
Component 

Campus Achievement 
Component 


Total Pre-Attendance 


2009-2010 


Award Amount 


$11,158,730.00 
$20,704,593.47 
$10,260,804.01 


$42,124,127.48 


2010-2011 
Award Amount 
$8,561, 767.50 
$18,485,521.11 
$8,314,794.65 


$35,362,083.25 


2011-2012 
Award Amount 

$3,027,709.75 
$12,165,894.17 

$2,475,655.50 


$17,669,259.42 


2012-2013 
Award Amount 

$4,594,727.50 
$11,253,275.00 

$2,234,564.00 


$18,082,566.50 


2013-2014 
Award Amount 

$5,070,085.00 
$13,788,623.33 

$3,064,490.00 


$21,923,198.33 


Attendance Bonus $343 242.52 N/A 


Total Award $42,467,370.00 $35,362,083.26 
*TIF money was paid to those meeting federal requirements of the grant. 


N/A 
$17,669,259.42 


N/A 
$18,082,566.50 


N/A 
$21,923,198.33 


Table 5. Summary of Total Award Amounts Paid, 2005-2006 to 2013-2014 


Model Year 

2005-2006 Award Model 
2006-2007 Award Model 
2007-2008 Award Model 
2008-2009 Award Model 
2009-2010 Award Model 
2010-2011 Award Model 
2011-2012 Award Model 
2012-2013 Award Model 
2013-2014 Award Model 
Total 


Total Award Amount 
$17,007,023.31 
$24,653,724.71 
$31,581, 703.46 
$40,564,693.83 
$42,467,370.00 
$35,362,083.26 
$17,669,259.42 
$18,082,566.50 
$21,923,198.33 

$249 311,622.82 


Table 6. 2005-2006 Teacher Performance-Pay Model (TPPM) Eligibility by Categorization 


Eligible Employees Paid Employees 
Eligible Paid Not Paid 
Minimumt Maximum? Mean 

Instructional 12,444 8,351 4,093 $100.00 $7,175.00 $1,805.13 
Non-instructional 4,673 1,534 3,139 $26.00 $500.00 $324.73 
Charter School Staff 143 88 55 $500.00 $4,000.00 $1,752.84 

Subtotal 17,260 9,973 7,287 
Principals 276 260 16 $890.00 $8,920 $4,923.07 
Total 17,536 10,233 7,303 


T Awards are prorated by FTE and percent of assignment at each qualifying campus. 

4 The maximum award amount paid for instructional staff included the attendance bonus. 

\Note: Charter school data combined both instructional and non-instructional employees due to the method of 
collecting the data from the schools. Charter school data were better defined in subsequent years. 


Table 7. 2006-2007 ASPIRE Award Eligibility by Categorization 


Eligible Employees Paid Employees 
Eligible Not Eligible Paid Not Paid | Minimumt Maximum Mean 

Instructional Core 8,111 981 | 7,208 $75.00 $7,865.00 $2,666.68 
Instructional, Non-core 4,388 1,072 | 3,548 840 $41.25 $2,530.00 $977.85 
Non-instructional 4,193 1,136 | 2,159 2,034 $62.50 $500.00 $369.74 

Subtotal 16,692 3,189 | 12,915 3,777 
Principals 259 12 242 17 $80.00 $11,760.00 4,812.33 
Total 16,951 3,201 | 13,157 3,794 


t Awards are prorated by FTE and percent of assignment at each qualifying campus. 
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Table 8. 2007-2008 ASPIRE Award Eligibility by Categorization 


Eligible 
Employees Paid Employees 
Eligible Not Paid Not 
Eligible Paid Minimumt | Maximum Mean 

Category A 1,287 10 1,275 12 $200.00 $8,360.00 $3,033.88 
Category B 2,644 54 2,400 244 $100.00 $7,920.00 $3,200.53 
Category C 1,376 32 1,375 1 $200.00 $8,580.00 $3,211.07 
Category D 3,188 38 3,055 133 $100.00 $5,390.00 $2,278.78 
Category E 706 7 687 19 $100.00 $5,100.00 $2,128.29 
Category A-E 

Subtotal 9,201 141 8,792 409 $100.00 $8,580.00 $2,773.94 
Category F 2,688 82 2,537 151 $100.00 $2,860.00 $1,196.11 
Category A-F 

Subtotal 11,889 223 11,329 560 $100.00 $8,580.00 $2,420.60 
Category G 1,506 46 1,179 140 $40.00 $1,522.50 $651.49 
Category H* 1,309 92 1,048 307 $25.00 $935.00 $431.62 
Category | 2,885 169 1,696 1,238 $75.00 $500.00 $376.59 
Category J 268 4 255 12 $200.00 $12,400.00 $5,102.42 
Category K 371 8 337 13 $100.00 $6,080.00 $2,962.63 
Ineligible Category 45 545 N/A N/A N/A N/A N/A 
Total 18,114 1,087 15,844 2,270 


T Awards are prorated by FTE and percent of assignment at each qualifying campus. 
*Six employees were paid a total of $25. These employees were teaching assistants from Gregory-LincolIn Elementary 
and Gregory-Lincoln Middle School who were awarded Strand 3B funds only. Strand 3B for these campuses was $25 
for Teaching Assistants, as these campuses were averaged with one campus rated “Recognized” ($50) and another 


rated “Academically Acceptable” ($0). 


Note: The maximum award amount for instructional staff included the attendance bonus. 
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Table 9. 2008-2009 ASPIRE Award Eligibility by Categorization 


Eligible Paid Employees 
Employees 
Not Not 
Eligible _ Eligible Paid Paid Minimum*t | Maximum Mean 

Category A 1,232 39 1,226 6 $200.00 $10,902.98 $4,094.03 
Category B 2,704 123 2,581 123 $100.00 $10,902.98 $4,103.14 
Category C 1,473 99 1,453 20 $200.00 $10,682.98 $4,260.72 
Category D 3,165 156 3,121 44 $200.00 $7,272.98 $2,886.38 
Category E 551 66 533 18 $158.81 $7,052.98 $2,665.22 
Category A-E 

Subtotal 9,125 483 8,914 211 $100.00 $10,902.98 $3,615.58 
Category F 2,297 192 2,211 86 $125.00 $3,422.98 $1,439.13 
Category A-F 

Subtotal 11,422 675 11,125 297 $100.00 $10,902.98 $3,183.03 
Category G 1,506 109 1,391 115 $40.00 $1,870.00 $725.59 
Category H* 1,309 215 1,085 224 $25.00 $1,210.00 $464.91 
Category | 2,885 332 1,480 1,405 $150.00 $750.00 $569.89 
Category J 268 7 264 4 $240.00 $15,530.00 $6,122.46 
Category K 371 5 365 6 $200.00 $7,765.00 $3,232.92 
Ineligible Category 45 3,775 N/A N/A N/A N/A N/A 
Total 17,806 5,118 15,710 2,051 


T Awards are prorated by FTE and percent of assignment at each qualifying campus. 
*Six employees were paid a total of $25. These employees were teaching assistants from Gregory-Lincoln Elementary and 
Gregory-Lincoln Middle School who were awarded Strand 3B funds only. Strand 3B for this campuses was $25 for 
Teaching Assistants, as these campuses were averaged with one campus rated “Recognized” ($50) and another rated 


“Academically Acceptable” ($0). 


Note: The maximum award amount for instructional staff included the attendance bonus. 
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Table 10. 2009-2010 ASPIRE Award Eligibility by Categorization 


Eligible 
Employees Paid Employees 
Not Not 
Eligible _ Eligible Paid Paid Minimum* | Maximum Mean 

Category A 1,103 29 1,088 15 $100.00 $11,330.00 $4,157.42 
Category B 2,724 156 2,687 37 $100.00 $11,110.00 $4,164.49 
Category C 1,494 106 1,493 1 $200.00 $10,670.00 $4,431.71 
Category D 3,186 192 3,154 32 $100.00 $7,260.00 $2,737.30 
Category E 671 57 661 10 $100.00 $7,040.00 $2,826.94 
Category A-E 

Subtotal 9,178 540 9,083 95 $100.00 $11,330.00 $3,614.65 
Category F 2,221 251 2,191 30 $100.00 $3,410.00 $1,593.99 
Category A-F 

Subtotal 11,399 791 11,274 125 $100.00 $11,330.00 $3,221.95 
Category G 1,678 161 1,572 106 $44.00 $1,870.00 $813.09 
Category H* 1,380 250 1,235 145 $25.00 $1,155.00 $544.36 
Category | 2,889 481 1,829 1,060 $150.00 $750.00 $563.89 
Category J 268 7 266 2 $200.00 $15,530.00 $6,300.54 
Category K 374 15 368 6 $100.00 $7,765.00 $4,036.20 
Ineligible Category 12 4,792 N/A 12 N/A N/A N/A 
Total 18,000 6,497 16,544 1,456 


T Awards are prorated by FTE and percent of assignment at each qualifying campus. 
*Only one employee was paid a total award of $25. This employee was a 0.50 FTE teaching assistant who was awarded 


Strand IIIB funds only. Strand IIIB for this campus was $50 for Teaching Assistants, as this campus was rated 


“Recognized.” 


Note: The maximum award amount for instructional staff included the attendance bonus. 
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Table 11. 2010-2011 ASPIRE Award Eligibility by Categorization 


Eligible 
Employees Paid Employees 
Not Not 
Considered Eligible _Eligible Paid Paid Minimum? Maximum Mean 

Category A 1,037 944 93 928 16 $200.00 $10,300.00 $4,212.94 
Category B 2,788 2,348 440 2,091 257 $100.00 $10,300.00 $4,592.92 
Category C 1,574 1,247 327 1,123 124 $200.00 $10,100.00 $4,557.09 
Category D 3,335 2,818 517 2,767 51 $100.00 $6,600.00 $2,846.13 
Category E 728 573 155 559 14 $100.00 $6,600.00 $2,733.06 
pepneaty ale 9,462 7,930 1,532 7,468 462 $100.00 $10,300.00 $3,753.89 
Category F 2,415 1,809 606 1,759 50 $100.00 $3,100.00 $1,536.75 
et ates 11,877. 9,739 2,138 | 9,227. 512 | $100.00 $10,300.00 $3,331.22 
Category G 1,489 1,129 360 1,056 73 $25.00 $1,700.00 $822.43 
Category H* 1,486 951 535 752 199 $50.00 $1,100.00 $581.38 
Category | 2,055 1,325 730 836 489 $183.75 $750.00 $556.31 
Category J 274 258 16 254 4 $240.00 $15,530.00 $6,555.09 
Category K 381 335 46 333 2 $100.00 $7,765.00 $3,571.04 
Melglble 3,966 0 3,966 N/A N/A N/A N/A N/A 
Category 

Total 21,528 13,737 7,791 | 12,458 1,279 


T Awards are prorated by FTE and percent of assignment at each qualifying campus. 
*Only one employee was paid a total award of $25. This employee was a 0.50 FTE librarian who was awarded Strand 
IIIB funds only. Strand IIIB for this campus was $50 for Instructional Support Staff, as this campus was rated “AEA: 


Academically Acceptable.” 


Table 12. 2011-2012 ASPIRE Award Eligibility by Categorization 


Eligible 
Employees Paid Employees 
Not Not 
Considered — Eligible _Eligible | Paid Paid | Minimumt | Maximum Mean 
Category A/B 3,670 3,033 637 2,036 997 $250.00 $9,000.00 $3,629.22 
Category C 1,358 1,082 276 710 372 $500.00 $9,000.00 $3,719.51 
Category D 3,172 2,648 524 1,738 910 $500.00 $5,500.00 $2,210.01 
Category E 731 554 177 339 215 $500.00 $5,500.00 $2,553.47 
Category A- 
E Subtotal 8,931 7,317 1,614 4,823 2,494 $250.00 $9,000.00 $3,055.48 
Category F 2,098 1,577 521 846 731 $200.00 $2,000.00 $1,043.82 
Category A- 
F Subtotal 11,029 8,894 2,135 5,669 3,225 $200.00 $9,000.00 $2,755.27 
Category G 1,198 910 288 435 475 $147.00 $1,350.00 $690.65 
Category H* 1,244 769 475 378 391 $100.00 $1,150.00 $607.47 
Category | 1,814 1,183 631 310 873 $200.00 $490.79 $500.00 
Category J 267 259 8 182 77 $825.00 $13,500.00 $4,441.00 
Category K 355 328 27 243 85 $412.50 $6,750.00 $2,301.06 
PelGible 1,615 0 1,615 N/A 0 N/A N/A N/A 
Category 
Total 17,522 12,343 5,179 7,217 5,126 
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Table 13. 2012-2013 ASPIRE Award Eligibility by Categorization 


Eligible 
Employees Paid Employees 
Not Not 
Considered Eligible _ Eligible | Paid Paid Minimum? Maximum Mean 

Group 1 4,384 2,692 1,692 1,670 1,022 $500.00 $13,000.00 $6,527.60 
Group 2 3,213 2,135 1,078 1,327 808 $500.00 $6,500.00 $2,402.22 
Group 3 1,280 875 405 452 423 $500.00 $6,500.00 $2848.95 
Group 1-3 8,877 5,702 3,175 3,449 2,253 $500.00 $13,000.00 $4,458.27 
Group 4 2,058 1,381 677 564 817 $245.00 $3,000.00 $1,710.53 
Group 1-4 10,935 7,083 3,852 4,013 3,070 $245.00 $13,000.00 $4,072.09 
Group 5 1,162 895 267 368 527 $147.00 $1,350.00 $717.60 
Group 6 1,224 729 495 323 406 $200.00 $1,150.00 $595.28 
Group 7 1,822 1,197 625 255 942 $250.00 $500.00 $497.65 
Group 1L 263 182 81 79 103 $2,500.00 $15,000.00 $8,702.53 
Group 2L 374 244 130 94 150 $1,250.00 $7,500.00 $4,867.02 
Ineligible 
Category 1,692 0 1,692 N/A N/A N/A N/A N/A 
Total 17,472 10,330 7,142 5,132 5,198 


Table 14. 2013-2014 ASPIRE Award Eligibility by Categorization, 


Group 1 
Group 2 
Group 3 
Group 1-3 
Group 4 
Group 1-4 
Group 5 
Group 6 
Group 7 
Group 1L 
Group 2L 


Ineligible 
Category 


Total 


Considered Eligible einige 
4,308 2,812 1,496 
3,248 2,366 882 
1,520 1,050 470 
9,076 6,228 2,848 
2,094 1,476 618 
11,170 7,104 3,466 
1,318 1,013 305 
1,265 824 441 
1,789 1,227 562 
269 258 11 
379 352 27 
1,845 0 1,845 
18,035 11,378 6,657 
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Eligible 
Employees 
# # Not 
Paid Paid 
1,870 942 
1,359 1,007 
539 511 
3,768 2,460 
702 774 
4,470 3,234 
413 600 
386 438 
266 961 
100 158 
137 215 
N/A N/A 
5,772 5,606 


Minimum 


$500.00 
$500.00 
$500.00 
$250.00 
$250.00 
$180.00 
$200.00 
$250.00 
$2,500.00 
$1,225.00 


N/A 


$500.00 


Paid Employees 


Maximum 


$13,000.00 
$6,500.00 
$6,500.00 
$13,000.00 
$3,000.00 
$13,000.00 
$1,350.00 
$1,150.00 
$500.00 
$15,000.00 
$7,500.00 


N/A 


Mean 


$7,107.75 
$2,728.66 
$2,884.16 
$4,924.18 
$1,784.94 
$4,431.17 

$736.71 

$596.89 

$498.12 
$8,250.00 
$4,552.55 


N/A 
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Table 15. Characteristics Comparing Teachers Receiving an Award to Districtwide Teachers, 2012- 
2013 to 2013-2014 


2012-2013 2013-2014 
District Award District Award 
N % N % N % N % 
Race/Ethnicity 
African American 3,918 35.8 1,160 30.1 4,133 36.5 1,249 28.4 
American Indian 21 0.2 9 0.2 22 0.2 9 0.2 
Asian/Pacific Islander 524 4.8 223 5.8 543 4.8 267 6.1 
Hispanic 3,003 274 1,092 283 3,029 26.7 1,309 29.7 
White 3,326 30.4 1,323 343 3,448 30.4 1511 = 34.3 
Two or More 166 1.5 47 1.2 162 1.4 59 1.3 
Gender 
Female 8,215 75.0 3,037 78.8 8,491 74.9 3,416 77.5 
Male 2,742 25.0 817 21.2 2846 8 25.1 990 22.5 
Highest Degree Held 
No Bachelor’s Degree 54 0.5 6 0.2 112 1.0 33 0.7 
Bachelor's Degree 7,515 68.6 2690 69.8 7,816 68.9 3,091 70.2 
Master’s Degree 3,198 29:2 4078 28.0 3,216 28.4 1,201 27.3 
Doctorate 191 if go 2.1 193. «1.7 81 1.8 
Years of Experience 
Beginning Teachers 1,140 10.4 304 7.9 1,282 11.3 325 7.4 
1to5 yrs. 2,602 23.7 1,019 26.4 2,938 25.9 1,204 27.4 
6 to 10 yrs. 2,455 22.4 868 22.5 2,380 21.0 949 21.5 
11 to 20 yrs. 2,787 25.4 974 25.3 2,801 24.7 1,171 26.6 
Over 20 yrs. 1,973 18.0 689 17.9 1,935 17.1 755 17.1 
Total 10,958 100.0 3,854 100.0 11,337 100.0 4,406 100.0 
Avg. Exp. 11.3 11.2 10.8 11.1 
Avg. HISD Exp. 9.3 9.3 8.5 9.0 


Note: For 2013-2014, PeopleSoft and PEIMS data were not available for 63 charter school employees in Group 1-4; 
for 2012-2013, PeopleSoft and PEIMS data were not available for 156 charter school employees in Group 1—4. For 
district totals taken from the Texas Academic Performance Report, the numbers were rounded. 


Source: Fall PEIMS Staff File: 2012 and 2013; Final Teacher Incentive File: 2012—2013 and 2013-2014; PeopleSoft 
extracts: 2012-2013 and 2013-2014; District Data: Texas Academic Performance Report District Profile, 2012-2013 
and 2013-2014. 


Table 16. Core Teachers with Individual Data Receiving Recruitment Incentives with ASPIRE Strand 


2ab Award Summary, 2013-2014 


Total 

N Incentive Minimum Maximum Average 
Received both Recruitment Incentive 
and ASPIRE Strand 2ab/Group 1 Award 312  $2,989,150.00 $5,675.00 $13,175.00 $9,580.61 
Recruitment Incentive Recipient but No 
ASPIRE Strand 2ab/Group 1 Award 295 $251,975 $675.00 $3,175.00 $854.15 
Total Core Teachers Receiving a 
Recruitment Incentive with Strand 
2ab/Group 1 Data 607 
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Table 17. Classroom Retention Status of all Campus-Based Teachers, 2010-2011 to 2013-2014 


2011-20127 2012-2013° 2013-2014° 

N % N % N % 
Teachers Retained in a Classroom Position 9,291 81.7 9,285 81.8 9,422 79.5 
Teachers Not Retained in the District 1,903 16.7 1,833 16.2 2,160 18.2 
Retained in the District but not the Classroom 176 15 226 2.0 269 2.3 
Total 11,370 100.0 11,344 100.0 11,851 100.0 


4 Retention for 2011-2012 teachers by August 5, 2012 

> Retention for 2012-2013 teachers by August 4, 2013 

© Retention for 2013-2014 teachers by July 21, 2014 

Note: Teachers were defined as those employees with a Job Function of teacher (TCH), Elementary Teacher (TEL), 
Prekindergarten teacher (TPK), or Secondary Teacher (TSC) with Department Type from 00 to 04. 


Table 18. Classroom Retention and Award Status of Campus-Based Teachers, 2011-2012 to 2013-2014 


2011-2012? 2012-2013 ° 2013-2014 ° 


N % N % N % 
Teachers Retained and Received any Award 5,000 56.9 3,468 51.4 3,903 52.7 
Teachers Not Retained and Received any Award 581 6.6 354 5.2 483 6.5 
Teachers Retained and Did Not Receive any Award 2,889 32.9 2,610 38.7 2,620 35.4 
Teachers Not Retained and Did Not Receive any Award 315 36 318 4.7 398 5.4 
Total Teachers with Retention and Award Data 8,785 100.0 6,750 100.0 7,404 100.0 
Core Teachers Retained and Received an Award 2» 1,672 59.0 899 346 1,111 408 
Core Teachers Not Retained and Received an Award 2: 225 7.9 132 5.1 169 6.2 
Core Teachers Retained and Did Not Receive an Award #5. 829 29.3 1,341 51.7 1,240 45.5 
Core Teachers Not Retained and Did Not Receive an Award 25. 107 3.8 223 8.6 205 7.5 
Total Core Teachers with Retention and Award Data 2,833 100.0 2,594 100.0 2,725 100.0 


4 Retention for 2011-2012 teachers by August 5, 2012; Core Teachers (Category A or B) refer to those eligible to receive a Strand 
2 Award for teacher progress. 

> Retention for 2012-2013 teachers by August 4, 2013; Core Teachers (Group 1) refer to those eligible to receive a Group 1 award 
for individual performance. 

© Retention for 2013-2014 teachers by July 21, 2014; Core Teachers (Group 1) refer to those eligible to receive a Group 1 award 
for individual performance. 

Note: Teachers were defined as those employees with a Job Function of teacher (TCH), Elementary Teacher (TEL), 
Prekindergarten teacher (TPK), or Secondary Teacher (TSC) with a Department Type from 00 to 04. 


Table 19. Summary of Value-Added Modules Accessed, 2013-2014 


Module N 

Decision Dashboard 23 
District & School Diagnostic/Performance Diagnostic 146 
District & School Value-added URM 374 
District & School Value-Added MRM 697 
Student Reports 238 
Student Search and CSRs 36 
Teacher Reports for Admins 17 
Teacher Value-added & Diagnostic 553 
Total (Duplicated) 2,084 


Source: SAS EVAAS® VLM Usage Reports, October 2013—July 31, 2014 
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Table 20. Summary of Completed Professional Development Courses, Cumulative Summary, 


9/18/2008 to 9/18/2015 


Course Title Attendance N 
Assessment Learn Introductory Course Completed 27 
Building/Teacher-Level Value-Added Completed 5 
Building/Teacher-Level Value-Added Learning Completed 1 
District-Level or System Level Value-Added Completed 1 
Foundations of Formative Instructional Practices-National Version Completed 10 
HISD Employee Orientation Training Completed 126 
HISD Gifted and Talented Completed 4 
HISD Highly Effective Teacher Study Completed 30 
HISD New Teacher Learning Path Completed 1 
Teacher-Level Value-Added Learning Completed 2 
Value-Added Learning Path-Level 1 Completed 4,748 
Value-Added Learning Path-Level 2 Completed 2,497 
Value-Added Learning Path-Level 3 Completed 85 
Value-Added Learning Path-Level 4 Completed 3 
Total (duplicated) Completed 7,560 


Source: Battelle for Kids, September 18, 2015 


Table 21. Summary of Completed Professional Development Courses, 2013-2014 
Course Completion N 


Teaching with the ELPS 2 
Introduction to Formative Instructional Practices 32 
Clear Learning Targets-National 20 
Collecting and Documenting Evidence of Student Learning-National 17 
Analyzing Data and Providing Effective Feedback-National 17 
Student Ownership of Learning: Peer Feedback, Self-Assessment, More 16 
Formative Instruction for Leaders-National 

Formative Instruction for Coaches-National 

Introduction & Research of the HISD HET Study 

Introduction to the Teacher-Level Value Added Learning Path 
Interpreting System Value-Added Reports 

Introducing Value-Added Reports 

Logging In, Examining the Home Page, and Navigating Value-Added Reports 
The Predicted Mean Approach to School Value-Added Reports 
Interpreting School Diagnostic Reports 

Interpreting Diagnostic Summary Reports 

Interpreting Individual Student Reports 

Performing Searches and Creating Custom Reports 

Interpreting Teacher-Level Value-Added Reports 

Progress and Achievement 

Total Course Completion 130 


Pill PJP] im[PlolRe/Plwo;aAsa 
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Table 22. Summary of Completed Learning Paths, 2013-2014 
Path Completion 


Building/Teacher-Level Value-Added Path (URM) 1 
Foundations of Formative Instructional Practices - National Version 15 
Foundations of Leading and Coaching Formative Instructional Practices 2 
Value-Added Learning Path - Level 1 1 
Total (duplicated) 19 


Table 23. Inquiry Comparison, 2006-2007 to 2013-2014 


Award Year Number Resolved with Resolved with No 
Considered Submitted Withdrawn Changes Changes 
N %* N % N % N % 
2006-2007 20,152 1,048 5.2 - - 251 1.2 797 4.0 
2007-2008 19,201 721 3.8 34 4.7 339 47.0 287 39.8 
2008-2009 22,924 621 2.7 2 0.3 167 26.9 452 72.8 
2009-2010 24,497 455 1.9 7 1.5 138 30.3 310 68.1 
2010-2011 21,528 856 4.0 6 0.7 329 38.4 521 60.9 
2011-2012 17,522 515 2.9 3 0.6 159 30.9 353 68.5 
2012-2013 17,427 521 3.0 6 1.2 111 21.3 404 77.5 
2013-2014 18,035 907 5.0 7 0.8 217 23.9 683 75.3 


Note: For 2006-2007, there were a total of 899 formal and 149 informal inquiries for a total of 1,048 inquiries that were 
processed. As the inquiry process became more refined in subsequent years, 2007—2008 and 2008-2009 data reflect only 
formal inquiries. For 2013-2014, there were two inquiry periods: Eligibility Confirmation and Final Inquiry Periods. 

Source: 2013-2014 inquiry data was extracted from the ASPIRE eNEWS January-March 2015; for 2012-2013, inquiry 
data provided by the ASPIRE Program Manager, Compensation and Salary Administration, personal communication, July 
28, 2015 and August 6, 2014; 2011-2012 ASPIRE Award Inquiry Report, 2010-2011 ASPIRE Award Inquiry Report, 
2009-2010 ASPIRE Award Inquiry Report, 2008-2009 ASPIRE Award Inquiry Report; Inquiry Results 2006-2007 ASPIRE 
Award. 

* Percent of all employees considered 

’ Percent of all inquiries submitted 


Table 24. Stanford 10 Achievement Performance, Non-Special Education Students (2007 norms), 2010 and 2014 


Mathematics Language Environment! Social 

Number Tested Reading NCE NCE NCE Science NCE Science NCE 
Grade 2010 2014 2010 2014 # 2010 2014 2010 2014 2010 2014 2010 2014 
1 10,484 11,632 49 45 49 50 57 49 46 45 
2 9,858 10,907 46 43 49 48 49 46 50 47 
3 10,450 11,770 47 47 53 56 49 48 49 50 45 46 
4 11,387 13,371 47 46 55 55 52 53 51 52 48 47 
5 12,899 14,022 47 45 55 54 50 48 53 56 48 49 
6 11,268 11,786 48 44 53 52 48 45 54 53 46 46 
7 11,264 11,908 45 44 54 53 47 47 51 51 48 47 
8 10,753 =11,481 48 47 55 55 48 46 57 59 54 52 
Total 88,813 96,877 47 45 53 53 50 48 51 52 47 48 
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Table 25. Aprenda 3 Achievement Performance for Reading and Mathematics, 2005 
(Before Performance Pay) and 2014, Non-Special Education 
Number Tested Reading NCE Mathematics NCE 
Before 
Grade 2005 


Table 26. Aprenda 3 Achievement Performance for Language, Environment/Science, and 


Social Studies, 2005 (Before Performance Pay) and 2014, Non-Special 
Education 

Language NCE Environment/Science NCE Social Studies NCE 
Before 


Grade 2005 


Table 27. English and Spanish STAAR Results for Reading and Mathematics % Satisfactory and 


Advanced, Spring 2013 and 2014: All Students 


Reading Mathematics 
2013 2014 2013 2014 

# % % # % % # % % # % % 
Tested SA AD | Tested SA AD Tested SA AD Tested SA AD 

3 15,564 74 19 | 16,769 68 16 15,492 65 15 16,616 £66 17 
4 15,096 65 18 | 15,671 66 16 15,004 64 16 15,545 £65 20 
5 14,100 70 17 | 14,762 68 16 14,009 69 19 14655 75 22 
6 12,399 64 17 | 12,453 68 12 11,940 70 15 12,091 73 16 
7 11,982 72 13 | 12,768 67 16 8,093 56 3 12,048 62 10 
8 11,779 77 20 | 12,414 75 18 12,401 76 6 9464 72 5 
Total 80,920 70 17 | 84,837 69 16 76,939 67 13 80,419 69 16 
Texas 76 20 76 18 72 14 74 16 


Note: SA (At Least Satisfactory) & AD (Advanced); Green shaded area reflects passing standard; 2013 District Data 


updated. 
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Table 28. English and Spanish STAAR Results for Science and Social Studies % Satisfactory and 


Advanced, Spring 2013 and 2014: All Students 


Science Social Studies 
2013 2014 2013 2014 

# % % # % % # % % # % % 

Tested SA AD Tested SA AD | Tested SA AD Tested SA AD 
3 
A 
5 14,174 66 9 | 14,798 66 9 
6 
7 
8 11,399 68 10 | 12,001 64 15 11,450 57 9 12,074 54 10 
Total 25,573 67 10 | 26,799 65 12 11,450 57 9 12,074 54 10 
Texas 74 13 72 15 63 13 62 14 


Table 29. English and Spanish STAAR Results for Writing % Satisfactory and Advanced, Spring 


2013 and 2014: All Students 


Writing 
2013 2014 
#Tested  %SA % AD # Tested % SA % AD 
3 
4 15,193 68 8 15,704 69 6 
5 
6 
7 12,063 64 4 12,745 66 6 
8 
Total 27,256 66 6 28,449 68 6 
Texas 70 6 71 6 


Note: SA (At Least Satisfactory) & AD (Advanced); Green shaded area reflects passing standard. 


Table 30. Number and Percent of Survey Respondents Indicating Their Level of Understanding for the 


ASPIRE Award Program and Its Components for the 2006-2007 and 2013-2014 ASPIRE 
Award, May 2008 and December 2014 Survey Administrations 


Please rate your level of 
understanding to the following 
items: 


My understanding of ASPIRE is: 
My understanding of value-added 
analysis Is: 
My understanding of the difference 
between student achievement and 
academic progress is: 
My understanding of how value-added 
information can help me as an 
educator is: 
My understanding of how to 
read/interpret value-added reports is: 
My understanding of the different 
components of the 2013-2014 
ASPIRE Award Program was: 
My understanding of how the ASPIRE 
Awards were calculated/determined is: 
See Data Limitations, p. 56. 
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% 
2008 


17.4 26.1 


21.3 33.5 
11.6 17.8 
18.3 28.6 
23.7 29.8 
23.2 33.8 
33.9 44.1 


Very Low/Low 


2014 


Very 
Sufficient High/High 
% % 

2008 2014 2008 2014 
55.2 45.1 27.4 288 
50.0 40.9 28.7 25.6 
43.9 43.4 445 38.7 
45.1 42.3 36.6 29.2 
47.0 42.6 29.3 27.6 
48.7 42.5 281 23.6 
43.9 37.5 22.2 18.4 
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Table 31. Number and Percent of Survey Respondents Indicating Their Perceptions About Award 
Amounts and the ASPIRE Award Model, March 2010 and December 2014 


Strongly 

Disagree! Agreel 

Disagree Neutral Strongly Agree 
N % % % 


2010 2014 2010 2014 2010 2014 #42010 2014 
There is a connection between 
classroom instruction and ASPIRE 5,428 2,927 34.2 40.7 27.6 22.7 38.3 36.6 
Award results. 
The maximum award amount for my 
ASPIRE Award category adequately 
recognizes my efforts to increase 
student progress. 
The maximum award amount for my 
ASPIRE Award category encourages 
me to remain in a campus-based 
position. 
The maximum award amount for my 
ASPIRE Award category is 
commensurate with my professional 
contribution. 
The ASPIRE Award is a fair way of 
acknowledging a teacher’s impact on 5,417 2,977 46.6 46.1 26.6 21.7 26.7 32.2 
student growth. 
The formal inquiry process allowed me 
the opportunity to question the 4,812 2,519 22.8 23.3 39.7 31.6 37.5 45.1 
accuracy of my award. 
The ASPIRE Award should be 
continued with modifications 5,367 2,925 18.9 23.9 32.4 21.8 48.7 54.2 
incorporated on an annual basis. 


5,274 2,864 44.4 46.1 26.5 20.2 29.1 33.7 


5,319 2,899 37.2 42.6 32.4 24.4 30.3 33.0 


5,325 2,886 44.9 48.1 28.5 21.4 26.6 30.5 


See Data Limitations, p. 56. 
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Table 32. Number and Percent of Survey Respondents Indicating Their Perceptions About Communicating 
Effectively, May 2009 and December 2014 


Not Effective! Moderately Effective/ 
N Somewhat Effective Very Effective 

Baseline 2014 Baseline 2014 Baseline 2014 
Knowing where to find information 
about the ASPIRE Award in general. SS s(n oom ee eee 
Knowing when specific information 
about my ASPIRE Award was 3,371 3,144 31.5 30.8 68.4 69.2 
available. 
Knowing where to find information 3,367 3,122 30.0 315 70.1 68.5 


about my specific ASPIRE Award. 
Knowing how to interpret and 
understand my specific ASPIRE 3,368 3,128 38.6 42.4 61.4 57.6 
Award Notice. 

Understanding the difference 
between submitting a question by e- 
mail versus submitting a formal 
inquiry about your final award. 
Understanding where to find 
information about the inquiry process 3,364 3,126 36.4 39.4 63.7 60.6 
on the portal. 

Understanding that formal inquiries 

were required to be submitted by a 3,352 3,129 34.7 35.1 65.4 64.9 
specific deadline. 

Providing clear explanations about 


3,362 3,124 38.6 42.1 61.4 57.9 


2,828 3,120 40.7 49.0 59.2 51.0 
the award model.* 
Providing clear explanations about 2,807 3,097 A5A 545 5A7 455 
value-added calculations.* 
Providing clear explanations about 3,011 3,121 519 536 48.1 46.4 


comparative growth calculations** 
* Baseline year for the items asterisked was 2012, and **Baseline year was 2013; it was 2009 for all other items. 


Table 33. Number and Percent of Survey Respondents Indicating Their Receipt for Different 
Types of Communication December 2014 


Yes No Not Sure 


School Messenger (automated phone system) 3,097 


ASPIRE eNews 3,052 69.9 18.1 12.1 
Academic Services Memos (electronic format) 3,006 55.8 25.5 18.6 
ASPIRE e-mail 3,152 86.7 7.2 6.1 


ASPIRE portal 2,942 
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Table 34. Number and Percent of Responses for Recommended Changes and Educational 


Impact to the 2013-2014 ASPIRE Award, December 2014 


N % 
Make the model fair, transparent, equitable, inclusive, with clear expectations 323 12.8 
Unintended Consequences (divisive, cheating, free-riding, highly 301 11.9 
effective/effective teachers leaving the district, negative culture) ; 
Allocate more money for awards/allocate money for specified group(s)/reallocate 
money so that particular groups benefit and designated groups receive no award 
or their award is capped/allocate funds to buying resources, scholarships for 287 11.4 
students, smaller classes, more tutors, clothes for students, attendance 
incentives for students 
Factors perceived as impacting growth or the calculation of growth 174 6.9 
Same earning opportunity as highest award category/award not commensurate 
with professional contribution at 0 
Discontinue the award 140 5.5 
Measuring growth/achievement (BOY/EOY/student growth/passing 
rates/campus, department, grade, subject, and/or individual award) ese 20-7 
Change the Eligibility and Categorization Rules and make plant operators, 
janitors, food service, hourly employees, and tutors eligible/Attendance Rule 
(more days/eliminate)/Attendance bonus (reinstitute the bonus)/Don't include 
Appraisal Ratings (Biased in some cases) especially Student Performance 
Measures 
N/A or No Comment 110 4.4 
Training 105 4.2 
Performance measures or criteria (e.g. position in hard-to-staff school, number of 
highly effective teachers and retention of them, college readiness and college 99 3.9 
acceptance, parent's role, working with students new to the district) 
Don't Know/Not Sure 87 3.4 
Calculation/Formula 85 3.4 
No Changes/Satisfied 79 3.1 
Improve communications about the award/provide clearer explanations about the 
model and value added calculations/provide feedback for teachers based on their 69 27 
data/more timely communications about changes in the award model/teacher , 
input 
Pay Raise 62 2.5 
Appraisal 54 2.1 
Miscellaneous 45 1.8 
Payout Timeline/Value-Added Timeline 32 1.3 
Create a different model for non-core teachers/special education teachers 28 1.1 
Years of Experience & Advanced Degrees 16 0.6 
Linkage 10 0.4 
Inquiry Process 6 0.2 
Missing 2 0.1 
Total 2,524 100.0 
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Table 35. Distribution of All Teacher Language Arts Cumulative Composite TGI (Value- 


Added Scores) by K-12 School Low Income Enrollment, 2013-2014 


4th 3rd pnd 1st 

Quartile Quartile Quartile Quartile 
Overall (<81) (81-91) | (92-95) | (96-100) 

N=1,834 N=452 N=364 N=551 N=467 
Well Above Average (> 2.00) 13.0 19.5 9.3 12.5 10.3 
Above Average (1.00 to 1.99) 14.8 19.7 14.0 14.3 11.3 
Average (-1.00 to 0.99) 48.8 45.6 51.9 46.5 52.2 
Below Average (-2.00 to -1.01) 12.5 10.0 14.3 13.4 12.6 
Well Below Average (< -2.00) 10.8 5.3 10.4 13:2 13.5 


Source: Poverty Levels as measured by percent eligible for free/reduced price meals from District and 
School Profiles, 2013-2014; EVAAS HISD Teacher-level Data File, 2014 


Table 36. Distribution of All Teacher Reading Cumulative Composite TGI (Value-Added 


Scores) by K-12 School Low Income Enrollment, 2013-2014 


4th 3rd 9nd 1st 

Quartile Quartile Quartile Quartile 

Overall (<81) (81-91) | (92-95) | (96-100) 

Well Above Average (> 2.00) 9.0 15.4 5.2 8.0 6.2 
Above Average (1.00 to 1.99) 12.7 16.8 7.6 13.7 11.6 
Average (-1.00 to 0.99) 51.4 49.9 53.8 50.7 51.7 
Below Average (-2.00 to -1.01) 16.1 12.1 19.4 16.6 17.0 
Well Below Average (< -2.00) 10.8 5.8 13.9 11.1 13.5 


Source: Poverty Levels as measured by percent eligible for free/reduced price meals from District and School 


Profiles, 2013-2014; EVAAS HISD Teacher-level Data File, 2014 


Table 37. Distribution of All Teacher Mathematics Cumulative Composite TGI (Value- 


Added Scores) by K-12 School Low Income Enrollment, 2013-2014 


4th 3rd 2nd 1st 

Quartile Quartile Quartile Quartile 
Overall (<81) (81-91) (92-95) | (96-100) 

N=1,875 N=493 N=400 N=537 N=445 
Well Above Average (> 2.00) 24.9 28.8 18.8 25.1 25.8 
Average (-1.00 to 0.99) 32.4 32.9 37.3 30.2 30.1 

Below Average (-2.00to-1.01) {426} 97) AS | T2183 

Well Below Average (< -2.00) 19.3 15.6 19.5 22.3 19.3 


Source: Poverty Levels as measured by percent eligible for free/reduced price meals from District and 
School Profiles, 2013-2014; EVAAS HISD Teacher-level Data File, 2014 
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Table 38. Distribution of All Teacher Science Cumulative Composite TGI (Value-Added 


Scores) by K-12 School Low Income Enrollment, 2013-2014 


Ath 3rd 2nd tst 

Quartile Quartile Quartile Quartile 
Overall (<81) (81-91) | (92-95) | (96-100) 

N=1,263 N=350 N=270 N=363 N=280 
Well Above Average (> 2.00) 86.1 27.1 14.4 19.3 13.2 
Above Average (1.00 to 1.99) 55.0 13.7 10.7 12.4 11.4 
Average (-1.00 to 0.99) 176.4 34.9 39.3 39.7 43.6 
Below Average (-2.00 to -1.01) 63.2 10.6 15.6 14.3 16.4 
Well Below Average (< -2.00) 70.4 13.7 20.0 14.3 15.4 


Source: Poverty Levels as measured by percent eligible for free/reduced price meals from District and School 


Profiles, 2013-2014; EVAAS HISD Teacher-level Data File, 2014 


Table 39. Distribution of All Teacher Social Studies Cumulative Composite TGI (Value- 


Added Scores) by K-12 School Low Income Enrollment, 2013-2014 


Ath 3rd 2nd 1st 
Quartile Quartile Quartile Quartile 
Overall (<81) (81-91) | (92-95) | (96-100) 
N=1,287 N=366 N=256 N=367 N=298 
Well Above Average (> 2.00) 19.0 28.1 15.6 15.5 14.8 
Above Average (1.00 to 1.99) 13.3 16.4 9.4 13.9 12.1 
Below Average (-2.00 to -1.01) 13.6 8.2 16.0 15.3 16.1 


Source: Poverty Levels as measured by percent eligible for free/reduced price meals from District and School 


Profiles, 2013-2014; EVAAS HISD Teacher-level Data File, 2014 
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APPENDIX B 
DATA COLLECTION 

Longitudinal, including baseline data, involved multiple departments and data sources. Human 
resources provided teacher attendance files and teacher staff files extracted from PeopleSoft for 2004— 
2005 through 2013-2014. Teacher recruitment data were provided for 2007—2008 through 2013-2014 from 
a PeopleSoft extract. The Teacher Performance Pay data file from 2005-2006 and the ASPIRE Award files 
for 2006-2007 to 2013-2014 were used to analyze participation and payout information. Districtwide 
performance data were extracted from the District and School Stanford and Aprenda Performance Report 
(Houston Independent School District, (2010e; 2013f, and 2015e), the State of Texas Assessments of 
Academic Readiness (STAAR) Standards-Based Performance, Grades 3-8, Spring 2014 (Houston 
Independent School District, 2013g and 2015f), and the State of Texas Assessments of Academic 
Readiness (STAAR) End of Course Results, Spring, 2014 (Houston Independent School District, 2013h 
and 2015g). Statewide data were extracted from the statewide summary data reports from the Texas 
Education Agency (TEA). For longitudinal comparisons, results were extracted from the 2005-2006 
Teacher Performance-Pay and 2006-2007 ASPIRE Award Program Evaluation (Houston Independent 
School District, 2009a), the 2005-2006 Teacher Performance-Pay and the 2006-2007 ASPIRE Award 
Survey (Houston Independent School District, 2009b), Inquiry Results 2006-2007 ASPIRE Award (Houston 
Independent School District, 2008c), the 2007-2008 ASPIRE Award Program Evaluation (Houston 
Independent School District, 2010a), the 2008-2009 ASPIRE Award Survey, Spring 2010 (Houston 
Independent School District, 2010b), the ASPIRE Award Inquiry Report 2008-2009 (Houston Independent 
School District, 2010c), the 2008-2009 ASPIRE Award Program Evaluation (Houston Independent School 
District, 2011a), the 2009-2010 ASPIRE Award Survey, Spring 2011 (Houston Independent School District, 
2011b), the ASPIRE Award Payout Report: 2006-2007 through 2009-2010 (Houston Independent School 
District, 2011c), the 2010-2011 ASPIRE Award Program Evaluation (Houston Independent School District, 
2012a) the 2010-2011 ASPIRE Award Survey, Spring 2012 (Houston Independent School District, 2012 
b), the 2010-2011 ASPIRE Award Payout Report (Houston Independent School District, 2012c), the 
ASPIRE Award Inquiry Report 2010-2011 (Houston Independent School District 2012d), the 2011-2012 
ASPIRE Award Survey (Houston Independent School District, 2013a), the 2010-2011 ASPIRE Award 
Program Evaluation (Houston Independent School District, 2013b), the 2011-2012 ASPIRE Award Payout 
Report (Houston Independent School District, 2013c), the 2011-2012 ASPIRE Award Inquiry Report 
(Houston Independent School District, 2013d), the 2011-2012 ASPIRE Award Program Evaluation 
(Houston Independent School District, 2014a), the 2012-2013 ASPIRE Award Survey (Houston 
Independent School District, 2014b), and the 2012-2013 ASPIRE Award Payout Report Updated July 2014 
(Houston Independent School District, 2014c), the 2013-2014 ASPIRE Award Survey (Houston 
Independent School District, 2015a), 2012-2013 ASPIRE Award Program Evaluation (Houston 
idenpendent School District, 2015b), The 2013-2014 ASPIRE Award Payout Report (Houston Independent 
School District, 2015 c). The 2012-2013 inquiry data were provided by the ASPIRE Program Manager, 
email message to authors, August 6, 2014. The 2013-2014 inquiry data were summarized in the 2015 
ASPIRE e-News January-March (Houston Independent School District, 2015d). Teacher characteristics 
data were extracted from the Texas Academic Performance Report, 2012—2013 and 2013-2014 (Texas 
Education Agency, 2012-2013 and 2013-2014). Statewide data were extracted from the STAAR Statewide 
Summary Reports (2012, 2013, and 2014). 

HISD charter schools provided teacher information in EXCEL spreadsheets which were manually 
entered for 2005-2006 to 2013-2014. Core courses were identified through discussions with staff from 
Federal and State Compliance as well as the Curriculum Department. The ASPIRE Award Core Subject 
Course Lists for 2006—2007 through 2013-2014 are posted on the ASPIRE website. 

For 2006-2007 through 2013-2014, the Department of Research and Accountability, Performance 
Analysis Bureau, provided Stanford 10, and Aprenda 3 test results to EVAAS® according to their 
requirements for calculation of district-wide value-added performance and ultimately classroom-level 
performance. The value-added data were returned to Battelle for Kids (BFK) for portal upload and to 
Performance Analysis who also received employee data from PeopleSoft, as well as collecting all employee 
and assignment data for non-HISD charter school employees. After Performance Analysis provided them 
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with HISD student and teacher linkage data from the Chancery system in the summer, BFK coordinated 
the process of verifying employee assignments in Fall, including teacher-student linkages, on the ASPIRE 
Portal. This information was provided to SAS EVAAS® in November after teachers reviewed and corrected 
the data if needed in September-October using the BFK portal, along with the Chancery assignment data 
previously provided to them. After coordinating with EVAAS® on the value-added data products that were 
necessary for award calculation in all strands of the model, HISD received EVAAS® teacher reports and 
cumulative Teacher Mean NCE Gain and Gain Index data August. In December, Award notices were posted 
for teachers to review. Teachers had one month to submit a formal inquiry to adjust any information that 
they questioned and to have their request reviewed. 

For 2005-2006, student-teacher linkages were determined at the secondary level using Chancery 
Student Management System (SMS) and by having campuses provide information at the elementary level. 
Elementary campuses also provided information regarding classrooms that were departmentalized or self- 
contained by grade level. Formal inquiry data and supporting documentation about the awards were 
collected through the HISD website or by FAX. Informal questions were collected by e-mail. 


INSTRUMENT DEVELOPMENT/SURVEY DATA COLLECTION 

The 2013-2014 ASPIRE Award Survey was developed to determine the perceptions and level of 
knowledge of participants regarding the 2012-2013 ASPIRE Award program paid out in February 2015. 
The survey items were developed from previous surveys, reviewed and approved by members of the 
ASPIRE Award Executive Committee with input from the Department of Human Resources and 
Professional Educator Compensation and Support (PECAS) Committee, and the modified instrument was 
piloted. The 2013-2014 ASPIRE Award Survey was administered on-line Wednesday, December 3, 2014 
to Friday, December 19, 2014, with follow-up reminders on Thursday, December 11, 2014 and Thursday, 
December 18, 2014. The survey responses were completely anonymous through SurveyMonkey with no 
IP addresses collected. For reporting purposes, the survey administration will be referred to as the 
December 2014 administration. 

The survey instrument was designed to allow participants to give their opinions and attitudes regarding 
the concept of performance pay and their level of understanding regarding the ASPIRE Award program. 
Questions employed a Likert scale or single-response format, with respondents given the opportunity to 
provide additional comments on open-ended questions. Open-ended questions centered on ways to collect 
feedback regarding motivation, provide areas for which communication was not effective, and to provide 
recommendations for making changes to the current model. The survey also addressed perceptions items 
that dealt with compensation. The survey instructions with the embedded link to access the survey were 
sent directly to campus-based employees, school improvement officers, and chief school officers. The data 
obtained from the completed surveys were downloaded from SurveyMonkey and imported into SPSS and 
ACCESS for analysis. 

Previous surveys were administered in March 2010 after the 2008-2009 ASPIRE Award program was 
paid in January 2010, May 2009 after the 2007-2008 ASPIRE Award program was paid in January 2009, 
May 2008 after the 2006-2007 ASPIRE Award program was paid in January 2008, and in December 2007 
after the 2005-2006 TPPM was paid in January 2007. For this report, when comparisons are made that 
include previous survey results, the information is presented by survey administration date. For example, 
the May 2009 survey administration referred to the 2007-2008 ASPIRE Award Model, and the May 2008 
survey administration referred to the 2006-2007 ASPIRE Award Model. Surveys were completed by 
respondents after the January payout of each award with the exception of the 2013-2014 school year 
where payout occurred after the survey was administered. Alternatively, the December 2007 survey 
administration referred to the 2005-2006 Teacher Performance-Pay Model (TPPM). Although results were 
collected after the January 2007 payout, the time frame was considerably longer (December) when 
compared to the subsequent survey administrations that were conducted in the month of May. 


HISD Research and Accountability 54 


APPENDIX B (CONTINUED) 


SURVEY PARTICIPANTS 

Survey invitations were sent to a total of 18,364 Houston Independent School District (HISD) campus- 
based employees on December 3, 2014 with 4,031 participants who responded to the survey (22.0 
percent). Table 1, p. 34 provides an nine-year summary of survey response rates by pay for performance 
model. Over the past nine years, the response rate increased from 11.4 percent for the December 2007 
administration to 25.7 percent for the January 2014 administration, and slightly declined to 22.0 percent for 
2013-2014. 

If survey participants were employed by HISD during the 2013-2014 school year, they were asked to 
indicate their eligibility status and categorization, for which 2,972 of the 4,031 respondents indicated their 
eligibility status and ASPIRE Award categorization (see Table 2, p. 34). 


DATA ANALYSIS 

Data analysis for the 2005-2006 Teacher Performance Pay Model followed the methodology described 
in 2005-2006 Teacher Performance-Pay and 2006-2007 ASPIRE Award Program Evaluation (Houston 
Independent School District, 2009a). The Department of Research and Accountability conducted the 
calculations for the model. Files produced for the model calculations and payouts were used for this 
evaluation report. 

Value-added analyses for the 2006—2007 through 2013-2014 ASPIRE Award were conducted by SAS 
EVAAS®, and the completed data files were sent to the Department of Research and Accountability and 
BFK. Calculations for the model were conducted by the Performance Analysis Bureau following the 
methodology outlined in the Appendices D, E, and F for 2013-2014. 

Districtwide teacher attendance rate calculations were analysed using two methods. In the first method, 
the sum of the number of hours present was added to the sum of the requested absence hours and the 
mandatory absence hours to arrive at the total number of hours scheduled. To calculate the teacher 
attendance rate, the number of hours present was divided by the total number of hours scheduled. In the 
second method, the number of hours present was added to the sum of the requested absence hours to 
arrive at the total number of hours scheduled. To calculate the teacher attendance rate, the number of 
hours present was divided by the total number of hours scheduled. The difference in the two methods 
centers on whether the calculation includes mandatory absences. Both methods are used for reporting 
purposes based on district policy. The teacher attendance file was then matched to the corresponding 
ASPIRE Award file to examine attendance rates for teachers receiving an ASPIRE Award and for eligible 
teachers that received the attendance bonus. 

Teacher retention rates were calculated for 2005-2006 to 2013-2014 using the same methodological 
procedures. Teachers were defined using the following job function codes: TCH (teacher), TEL (Elementary 
Teacher), TPK (Prekindergarten Teacher), or TSC (Secondary Teacher). Teachers were required to be 
employed in the district during the 2013-2014 school year. Retained teachers were those that returned to 
the district in a campus-based teaching position, based on job function, for the first duty date the following 
the school year, 2014—2015. A retained teacher’s employee status for the 2014—2014 school year included 
the following: A (active), L (leave), P (paid leave), or S (Suspended). Teachers were not considered retained 
if their status was R (retirement), D (death), or T (terminated) or if they left the classroom, but remained in 
the district. Retained teachers and those that were not retained were matched to the corresponding ASPIRE 
Award file to determine those teachers that received Strand 2A, 2B, or Goup 1 awards (teacher progress 
awards). Teachers that received special analysis, for which campus-level value-added scores were used, 
were not included. Retained teachers and those that were not retained were also matched to the 
corresponding award file to determine if those teachers received any ASPIRE Award. To calculate retention 
rates of highly effective teachers for high needs schools, value-added files were matched to the retention 
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file for those schools that TEA identified as Improvement Required. Those teachers retained in the 
classroom and earning a 2.00 or higher in their subject area were selected. 

Teacher recruitment data for 2007-2008 to 2013-2014 were provided by the Human Resources 
Department. The number of teachers recruited and receiving retention bonuses were calculated. The 
recruitment files were matched to the corresponding ASPIRE Award file to determine if those teachers 
received a Strand 2A, 2B, or Group 1 award. Teachers that received special analysis for their award were 
excluded from the analysis. 

Both quantitative and qualitative research methods were employed to analyze the results of the 
surveys. Descriptive statistics in terms of frequencies, percentages, and cross tabulations were used to 
examine the single-response items and items employing a Likert scale. Percentages do not always add up 
to 100 due to rounding. Items that were skipped or for which respondents answered "N/A" were coded as 
missing data, and not included in the analysis. For the open-ended questions, qualitative analysis used the 
text analysis package on SurveyMonkey to develop emergent categories. The results were reported using 
frequency counts and percentages based on the number of responses. Results from selected items were 
compared with previous survey administrations to gain a longitudinal perspective regarding perceptions, 
level of knowledge, and feedback. 


DATA LIMITATIONS 

Pearson, Inc. updated the Stanford Achievement Test Series, Tenth Edition (Stanford 10) to 2007 
norms in 2009. The previous Stanford 10 results used 2002 norms. This update caused a shift in the 
National Percentile Rank (NPR) and Normal Curve Equivalent (NCE) scores, which is typical when a test 
changes norms. Pearson provided the 2008 Stanford 10 data using the updated 2007 norms so that a two- 
year comparison could be made. It is not appropriate to compare 2011 data using 2007 norms with data 
that used 2002 norms. For this report, 2010 and 2013 Stanford 10 data with the 2007 norms are presented. 

Changes in the structure of the survey instrument as well as coding practices limited to some degree 
comparisons to the results of previously developed survey instruments. Since questions were developed 
through the different survey administrations, the point of comparison in each table or analysis centers on 
the year all of the items were fully developed, these varying base years are presented. Additionally, the 
response rates are fairly low and the results, while informative, may not be generalized to the population. 

For teacher attendance, the system of calculating the scheduled hours was not refined enough to take 
into account teachers or administrators that may have changed contracts in the middle of the year (i.e. 10- 
month to 12-month). Calculations for teacher attendance were adjusted based on this limitation. The sum 
of the scheduled hours in the Peoplesoft databases (2004-2005, 2005-2006, 2006-2007, 2008-2009, 
2009-2010, 2010-2011, 2011-2012, 2012-2013, and 2013—2014) did not equal the the sum of the Hours 
Present plus the Requested Absence Hours, although it should. Therefore, the denominator used in 
calculating attendance summed the Hours Present plus the Requested Absence Hours. For teacher 
retention, there were cases when teacher data were not available for the first duty date of the following 
year. In these instances, a history was requested from PeopleSoft to examine employee status. The cut- 
off date for these exceptions was the end of August. Therefore, if an employee was an active employee, 
on leave, or suspended and if the employee was in a campus-based position at the end of August, they 
were considered retained. 

For teacher recruitment, secondary teachers did not receive teacher-level value-added reports prior to 
2012, when the district began to phase these reports in for teachers of courses with fully-implemented End- 
of-Course (EOC) exams only. Therefore, they were not included in the analysis, and recruitment 
effectiveness using value-added data could not be fully evaluated. 


HISD Research and Accountability 56 


APPENDIX C 


General Eligibility Requirements 

To be eligible to participate in the 2013-2014 ASPIRE Awards, HISD employees must 

meet all of the following general eligibility requirements: 

1. Employees must be supervised and appraised by the principal or other designated appraiser of the 
campus where they are serving students. Employees not supervised or appraised by the principal or 
campus 

appraiser are not eligible—even if 100% of their time is spent on a campus (e.g., food service employees, 

Plant Operators, custodians). 

2. Employees must have a job/record position assigned to a campus, and must have a campus ID as their 

department ID by September 10, 2013. Employees whose job record/position is assigned to non-campus 

departments for time reporting are not eligible. 

3. Employees must be continuously employed in an eligible position through the last day of school. 

4. Employees must work at least 40% of the school time (equivalent to two days per week) at the same 

campus. 

5. Employees must complete the instructional-linkage and assignment-verification process—or have this 

completed by their principal—through the ASPIRE portal by the submission deadline as published 

annually. It 

is recommended that employees review instructional-linkage and assignment-verification information on 

the 

ASPIRE portal for accuracy. 

6. Employees may “opt out” of ASPIRE Awards during the linkage and verification process. If an employee 

does 

not make a selection, the employee will be included in award consideration. 

7. Non-administrative employees eligible under other incentive plans are not eligible (e.g. Sr. Academic 

Tutor). 

8. Hourly employees in any capacity—including substitute/associate teachers—are not eligible. Employees 

holding an hourly or substitute position must be converted to a non-hourly position by September 10, 2013. 

9. Employees who take leave of absence during the eligibility period (e.g., temporary disability, but not 

family 

medical leave) are not eligible. 

10. Employees cannot be absent for more than 10 instructional days during the “instructional school year” 

(77.50 

hours for staff on a 7.75-hour day1; 80.00 hours for staff on an 8-hour day).This means first-year 

employees 

must commence employment no later than September 10, 2013, as any instructional days missed from the 

start of their campus’ instructional school year to the date employed will be counted as absent. Early 

release 

days are treated as other instructional days—the entire day (7.75 hours, or 8.0 hours) is considered 

instructional. The following types of leave will be held harmless and not count as days absent: 

Funeral leave(coded as funeral leave, not as “additional funeral leave,” per board policy) 

Military leave 

Family medical leave 

Assault leave 


1Some teachers are located at campuses where extended time is worked. This extended time is paid at the time it was 
worked. When absences are incurred, teachers’ leave banks are charged for the regular length of the day (7.75 
hours), and not for any additional time. Therefore, for all teachers, one day’s absence is 7.75 hours, and 10 days of 
absences remain at 77.50 hours regardless of the extended hours at the campus. 


HISD Research and Accountability 57 


Appendix C (Continued) 
Jury duty 
Holidays 
Religious holidays 
Floating holidays 
Vacation pay 
Compensatory time 
Authorized off-campus duty 


Family medical leave, military leave and assault leave must be authorized through Human Resources (HR) 
at the time of the leave 


11. Employees who receive a final summative rating of “Ineffective” or “Needs Improvement” for the 
2013-2014 school year, according to the Teacher Appraisal and Development System or the School 
Leader Appraisal System, are not eligible. This final summative rating includes a Student Performance 
measure for applicable employees. 


12. Employees who were on a Prescriptive Plan of Assistance (PPA) based on the 2013-2014 
information as determined by multiple measures including observations, walkthroughs, student 
performance, etc. and whose performance goals were not met by the end of the 2013-2014 school 
year are not eligible. 


13. Employees who retire or resign in lieu of termination are not eligible. 


14. For Principals to be eligible, all teacher positions at the campus must be fully staffed as of the first day 
of school, August 26, 2013. Principals of campuses who have teaching vacancies as of the first day 
of school can appeal their eligibility status. 


Position Eligibility Requirements and Award Groups 
Different positions within HISD qualify for various aspects of ASPIRE Awards. Following are definitions for 
position groups and eligibility requirements that will be used to group employees for award purposes: 


Instructional Position Groups 
Employees must be certified teaching staff and fall into either core foundation or elective/ancillary 
instructional positions as defined below. 


Core Foundation Teaching Positions 

Employees must be assigned to a campus, plan lessons, provide direct instruction to students, and be 
responsible for providing content grades—not conduct or participation grades—for ASPIRE core 
foundation courses for the majority of the day/school year. 


ASPIRE Core Foundation Courses 

ASPIRE Core Foundation Courses include those courses identified by the Texas Education Agency under 
the Core Foundation areas of English Language Arts/Reading, Mathematics, Science and Social Studies 
at the elementary and middle school level and those Core Foundation courses required for graduation 
credit in the 4x4 Recommended or Distinguished High School Diploma programs and/or those courses that 
contribute directly to data collected and interpreted as part of the growth measure. Fifty percent of the 
teaching assignment must be in ASPIRE Core Foundation courses to be considered as core foundation 
instructional staff for the purposes of the award. 
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Group 1. Core Foundation Teachers, Grades 3-11, with EVAAS™ Value-Added Report 


To be considered in this group, employees must teach at least one and as many as five core foundation 
subjects for which a value-added report is generated. Student linkages are required to be provided during 
the spring linkage process in order for a teacher to be considered in this category. A teacher-level value- 
added report must be produced in order to be considered in this group. 


Group 2. Core Foundation Teachers, Pre-Kindergarten through Grade 2 


To be considered in this group, employees must qualify as core foundation instructional staff and teach 
core foundation subjects to students in pre-kindergarten through grade 2 for the majority of the school day. 
Student linkages for students in grades 1-2 are required to be provided during the spring linkage process 
in order for a teacher to be considered in this category. 


Group 3. Core Foundation Teachers, Grades 3-12, without EVAAS~™ Value-Added Report 


To be considered in this group, employees must qualify as core foundation teachers. Core foundation 
courses must be taught the majority of the school day. For a complete list of these courses, please review 
the master course list with ASPIRE core foundation subjects. This group may include special education 
teachers who teach core foundation courses where a value-added report cannot be generated, high school 
teachers of students in grades and subjects for which a value-added report cannot be generated, or 
teachers of low class sizes. Student linkages for students in grades 3-11 are required to be provided 
during the spring linkage process in order for a teacher to be considered in this category. 


Elective/Ancillary Instructional Positions 
Group 4. Elective/Ancillary Teachers 


To be considered in this group, employees must teach elective/ancillary classes (e.g., art, music, physical 
education, etc.) for the majority of the school day/year. 


Other Position Groups 


In addition to recognizing instructional staff, ASPIRE Awards also acknowledge the contributions of 
employees who contribute to student growth in other ways throughout the school year: 


Group 5. Instructional Support Staff 


Instructional support-staff members are degreed, certified or licensed professionals assigned to a campus 
and provide direct support to the instruction of students. If the instructional support-staff member is 
assigned to multiple campuses, the percentage of assignment to a single campus cannot be less than 
40%. Instructional support staff must have a campus ID as their department ID. Instructional support staff 
may link students and receive a value-added report, but the production of a value-added report does not 
place an employee as a core foundation teacher for the purposes of determining ASPIRE Award groups. 
For example: counselor, librarian, nurse, speech therapist, speech therapist assistant, evaluation specialist, 
instructional coordinator, content area specialist, school-improvement facilitator, API, social worker, literacy coach, 
Magnet or Title | coordinator. 


Group 6. Teaching Assistants 


Teaching assistants are staff members who have a job classification of “Teaching Assistant” and provide 
direct classroom instructional support to instructional staff. 


Group 7. Operational Support Staff 


Operational support-staff members are campus-based employees who do not meet the requirements for 
instructional staff, instructional support staff, or teaching assistants. For example: school secretary, data entry 
clerk, teacher aide, clerk, attendance specialist, business manager, SIMS clerk, computer network specialist, 
registrars, Campus Education Technician. 
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Campus Leadership Groups 


ASPIRE Awards recognize campus leadership for their contribution to student progress and achievement 
based on campus performance. Certification for these positions is required in order to be considered for 
these categories. The following describe the award group eligibility criteria for leadership positions: 


Group 1L. Principals 


To be considered in this group, employees must meet all general eligibility requirements and be the 
“principal of record” according to HR and PeopleSoft. 


Group 2L. Assistant Principals/Deans of Instruction/Deans of Students 


To be considered in this group, employees must meet all eligibility requirements and be coded as an 
assistant principal, dean of instruction, or dean of students according to HR and PeopleSoft. 


Additional Position Eligibility Requirements 


1. For an employee who transfers or is reassigned from one ASPIRE Award-eligible position to another 
ASPIRE Award-eligible position during the eligibility period, the award will be determined on the basis of 
the ASPIRE Award-eligible position the employee held the greatest percentage of the school year 
(based on the 180-day academic calendar).For example: On September 5, an employee teaches third-grade 
math. On February 5, the employee transfers to content specialist on the same campus. Both assignments are 
ASPIRE Award-eligible. However, the award model and eligibility requirements differ. In this case, the greatest 
percentage of the “school year” was spent as a third grade core foundation teacher. Therefore, the award amount 
would be determined on the basis of the job, a third grade core foundation teacher. 


2. For an employee who transfers from an ASPIRE Award-eligible position to a non-eligible position during 
the eligibility period, he/she will not be eligible for an award (See General Eligibility Requirements 1, 2 
and 3). 


3. ASPIRE Awards for employees who function in multiple award groups (above) will be determined based 
on the job in which they function for the majority of their work day. 


4. Employees must have credentials for the position in which they function to be eligible under that 
category. For example: A teacher teaching twelfth-grade math must be certified or on permit to teach twelfth- 
grade math in order to be eligible as a core foundation teacher. 


5. For employees who meet the criteria of a Group 1 teacher but teach additional grade levels that are not 
included in the teacher’s value-added report, awards will be based on the value-added report only. For 
example: If a teacher teaches second- and third-grade reading, and a value-added report is obtained for third- 
grade based on the direct measure of student growth, the teacher would be considered for Group 1 awards, and 
would not be considered for Group 2 awards. 


6. The production of a value-added report does not necessarily place an employee in Group 1 for awards. 
For example: If a value-added report is produced to measure the growth of students by a literacy coach for 
diagnostic and instructional improvement, the literacy coach is not considered as a core foundation teacher; the 
literacy coach remains in Group 5 for award purposes. 
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ASPIRE Award Calculation and Payout Rules 

ASPIRE Awards will be calculated on the basis of the HISD board-approved model. Certain 

situations require the adoption of the following award calculation rules in order to apply the award model 
appropriately: 


1. Employees who work less than full time must work at least 40% of the school time (equivalent to two 
days per week) at the same campus to be eligible to receive a prorated ASPIRE Award. The prorated 
ASPIRE Award will be based on the full-time equivalent (FTE) of their eligible position, the portion of 
time spent in the eligible position, and the ASPIRE Award level. For example: A half-time employee (or 0.5 
FTE) who spends all of his or her time at a single campus would be eligible to receive 50% of the award. This same 
employee who works 50% of his/her time at two campuses (0.25 FTE at each campus) would not be eligible. 


2. Awards for employees whose job record/position is assigned to a campus department for time reporting 
who are assigned to and work on multiple campuses a minimum of 40% of the time and report directly to 
the principal (principal is responsible for supervising and evaluating the individual employee) will be 
calculated and prorated on the basis of the percentage of campus assignments. Examples include 
evaluation specialists, content specialists, speech therapists and various special education positions. For 
example: A campus-assigned, campus-based employee works 50% of his or her time at campus A, 25% at campus 
B, and 25% at campus C. If the employee is eligible for an ASPIRE Award based on campus data, then the 


employee would receive 50% of the eligible payout at campus A, and would not receive an award for campus B or 
C. 


3. Good Standing: 


e Employees must be in good standing at the time of payment. Therefore, an employee under 
investigation or reassigned pending investigation is not eligible for an ASPIRE Award until he or 
she is cleared of any allegation. If the investigation is concluded with a confirmation of 
inappropriate employee behavior, the employee is not eligible to receive an ASPIRE Award. 


4. If an employee meets all of the eligibility requirements for an award and then resigns or retires from the 


district prior to the payout of the awards, the employee is still eligible for the ASPIRE Award. It is 
incumbent upon the employee to provide the district with correct forwarding information so that the 
award payment can be processed. 


5. For Principals Only: 


e The campus must also be in good standing. If the campus had an approved waiver to the district- 
testing procedures and if any testing improprieties are reported and confirmed or otherwise 
substantiated at the campus, the principal will be ineligible to receive an ASPIRE Award. 
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ASPIRE AWARD MODEL 
TEACHERS AND CAMPUS-BASED STAFF 
2013-2014 


There are four major components of the ASPIRE Award Model for Teachers and Campus-Based Staff: 1) 
Group Performance based on Campus Value-Added; 2) Group Performance based on Campus Academic 
Achievement; 3) Group Performance based on Grade/Subject Student Growth; and 4) Individual 
Performance based on Teacher Value-Added. 


Groups Considered in ASPIRE Award Model 


Instructional Staff-The individuals included in this group are assigned to a campus, provide direct 
instruction to students, and are responsible for providing grades to students at the classroom level (i.e., core 
foundation and elective/ancillary teachers). 


Instructional Support Staff-Instructional support staff members are degreed, certified, or licensed 
professionals assigned to a campus and provide direct support to instructional staff/campus. If the 
instructional support staff member is assigned to multiple campuses, the percentage of assignment to a 
single campus cannot be less than 40 percent. 


Examples: Counselor, Librarian, Nurse, Speech Therapist, Speech Therapist Assistant, Evaluation 
Specialist, Instructional Coordinator, Content Area Specialist, School Improvement Facilitator, Social 
Worker, Psychologist, Literacy Coach, Magnet Coordinator, Title | Coordinator 


Teaching Assistants- These individuals are staff members that have a job classification of Teaching 
Assistant and provide direct classroom instructional support to instructional staff. 


Operational Support Staff- Operational support staff members do not meet the criteria for instructional or 
instructional support staff or teaching assistants. 


Examples: School Secretary, Data Entry Clerk, Teacher Aide, Clerk, Attendance Specialist, Business 
Manager, SIMS Clerk, Computer Network Specialist (CNS), Registrar, CET 


Group Performance: Campus Value Added 


Purpose: Reward all eligible campus staff for cooperative efforts at improving individual student 
performance at the campus level through the application of campus-level value-added analysis of student 
academic progress. 


Groups Included: Instructional, Instructional Support, Teaching Assistants, and Operational Support. 


Method for Group Performance: Campus Value-Added 


Indicator: EVAAS® Campus Composite Value-Added Gain scores calculated across grades and subjects 
to provide an overall campus value-added score (Cumulative Gain Index “CGI”). See the ASPIRE portal for 
more detailed information on the calculation of EVAAS scores. 


(http://static.battelleforkids.org/Documents/HISD/VA/Cumulative Gain and Composite Calculations.pdf) 


The Campus Composite Value-Added Gain Scores (CGI) are rank ordered by academic levels. Staff at 
schools in the first quintile with positive (greater than zero) CGls receive awards. 
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Campus Value Added Awards Matrix 

Comparable Campus by School Level Campus Composite Value-Added Gain Score 

(Across Subjects and Across Grades) 
Elementary Schools, Middle Schools Quintile 1 Quintiles 2 -5 
and High Schools Ranked Separately | Cumulative Gain Index Cumulative Gain Index 
Instructional Staff $2,000 $0 
Instructional Support Staff $750 $0 
Teaching Assistants $750 $0 
Operational Support Staff $500 $0 


Group Performance: Campus Academic Achievement 


Purpose: Reward instructional, instructional support, and teaching assistant staff for cooperative efforts at 
meeting student achievement levels or improving student performance at the campus level. 


Groups Included: Instructional, Instructional Support, and Teaching Assistants. 


Method for Group Performance: Campus Academic Achievement 


Indicators: Stanford/Aprenda -- percent of all students at or above 50" National Percentile Rank (NPR); 
AP/IB -- percent of all campus students scoring at a level to earn college credit or growth in this percent 


Elementary and Middle Schools 


This component of the Group Performance Award is designed to reward instructional, instructional support, 
and teaching assistant staff at elementary and middle schools for which 85% of all students across all grade 
levels have scored at or above the 50" National Percentile Rank (NPR) on 2013-2014 Stanford/Aprenda or 
for which the campus has exhibited significant improvement in the percent of students across all grades at 
this rank. Significant improvement is defined as being in the top quintile (top 20%) of schools within 
elementary school rankings or middle school rankings. Schools are rank-ordered at the elementary and 
middle school levels, separately. K-6 and K-8 schools are ranked with elementary schools. Schools are 
ranked and awarded separately for Math and Reading. 


Campus Academic Achievement Awards Matrix — Elementary and Middle Schools 
Percent of Students At Distribution of Percentage-Point 
or Above 50" NPR) - Improvement in Percent of Students At 
Math or Above 50" NPR - Math 
Campus Staff Award Standard: 85 % Quintile 1 Quintiles 2 -5 
Mecauera Instructional Staff $500 NA NA 
Standard Instructional Support Staff $300 NA NA 
Teaching Assistants $200 NA NA 
Did not Instructional Staff NA $500 $0 
meet Award | Instructional Support Staff NA $300 $0 
Standard Teaching Assistants NA $200 $0 
Percent of Students At Distribution of Percentage-Point 
or Above 50" NPR) - Improvement in Percent of Students At 
Reading or Above 50" NPR - Reading 
Campus Staff Award Standard: 85 % Quintile 1 Quintiles 2 -5 
Mecaward Instructional Staff $500 NA NA 
eiendard Instructional Support Staff $300 NA NA 
Teaching Assistants $200 NA NA 
Did not Instructional Staff NA $500 $0 
meet Award | Instructional Support Staff NA $300 $0 
Standard Teaching Assistants NA $200 $0 
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High Schools 


This component of the Group Performance Award is designed to reward instructional, instructional support, 
and teaching assistant staff at high schools where students attain high levels of achievement or exhibit 
significant improvement in the percentage of their students with college-credit earning Advanced Placement 
(AP) and International Baccalaureate (IB) exam performance. 


APIIB Participation and Performance 


1. 


AP test data are extracted from the AP data provided by the College Board for 2012—2013 and 
2013-2014. Student-level IB test data are downloaded from the International Baccalaureate 
Organization and provided to the Department of Research and Accountability from campuses that 
participate in the International Baccalaureate program. Because the electronic data files for both AP 
and IB are dynamic, a cut-off date is used for reporting purposes. 

Total enrollment in grades 10-12 for each campus as of the fall PEIMS snapshot date in 2012 and 
2013 are collected. 

The participation/performance rate for each year at each campus is calculated using the number of 
students in grades 10-12 with at least one AP exam with a score of 3 or higher (an unduplicated 
count of students), by total grade 10-12 enrollment, all values expressed to the nearest tenth of a 
percentage point (0.1). The participation/performance rate for each year at campuses with both an 
AP and an IB program is calculated using the number of students in grades 10-12 with at least one 
AP exam with a score of 3 or higher plus the number of students in grades 11-12 with at least one 
IB exam with a score of 4 or higher (an unduplicated count of students), by total grade 11-12 
enrollment, all values expressed to the nearest tenth of a percentage point (.1). 

Eligible staff at a campus that meets the 2013-2014 award standard of 40.0 percent are awarded 
for this strand component. There is no rounding to meet the standard (i.e., 39.9 percent is not 
awarded). 

Campuses that do not meet the standard are rank-ordered according to the percentage-point 
change in their participation/performance rates between 2012-2013 and 2013-2014, with both the 
underlying values and this change expressed to nearest tenth of percentage point. Only campuses 
with at least five students testing each year and hence a participation/performance rate for both 
years are rank-ordered. Campuses that do not have their own data are not included in the analysis 
and will not be awarded on this strand. 

Campuses rank-ordered by participation/performance rate changes between 2012-2013 and 2013- 
2014 are placed into quintiles. Eligible staff at campuses ranked in the first quintile (top 20%) are 
awarded provided the participation/performance rate change is positive. 


Campus Academic Achievement Matrix — High Schools 


Participation/Performance Distribution of 
Rate: Percent of Students Percentage-Point 
in Grades 10-12 witha Improvement in 
score of 3or higher (AP) | Participation/Performance 
or 4 or higher (IB) Rate 
Campus Staff Award Standard: 40.0 % Quintile 1 | Quintiles 2-5 


Did not Instructional Staff NA $1,000 $0 


Instructional Staff $1,000 NA NA 
Instructional Support Staff $600 NA NA 
Teaching Assistants $400 NA NA 


Met Award 
Standard 


meet Award | Instructional Support Staff NA $600 $0 
Standard | Teaching Assistants NA $400 $0 
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Group Performance: Grade/Subject Student Growth 


Purpose: Reward eligible core foundation instructional staff for group efforts at improving student academic 
performance at the classroom/student cohort level through the application of campus-level value-added or 
comparative growth analysis of student academic progress. 


People Included in Group Performance: Grade/Subject Student Growth 


Core Foundation Instructional Staff: For employees to qualify as core foundation instructional staff, 
employees must be assigned to a campus, plan lessons, provide direct instruction to students, and be 
responsible for providing content grades, not conduct or participation grades for ASPIRE core foundation 
courses for the majority of the day/school year. At least two of the teaching assignment must be ASPIRE 
Core Foundation courses to be considered as core foundation instructional staff for the purposes of the 
award. 


There are two different groups of core foundation teachers who qualify for this component of 
the award, depending on grades taught. Each has distinct indicators. 


For core foundation teachers of Early Childhood - Grade 2: To be considered in this group, employees 
must qualify as core foundation instructional staff and teach core foundation subjects to students in Pre- 
Kindergarten through grade 2 for the majority of the school day. 


For core foundation teachers of Grades 3-12: To be considered in this group, employees must qualify as 
core foundation instructional staff. Core foundation courses must be taught the majority of the school day. 
This group may include special education teachers who teach core foundation courses in grades 3—10 where 
a value-added report cannot be generated, high school teachers of students in grade 12, or teachers of low 
class sizes in grades 3-8. 


Methods for Group Performance: Grade/Subject Student Growth 


Early Childhood-Grade 2 Core Foundation Teachers 


In this method, the second-grade Comparative Growth scores for reading and for math at a campus are 
used in the assessment of Early Childhood (PK)-grade 2 core foundation teachers. Campuses are 
compared to other campuses for each subject based on the second grade score for each subject and then 
placed into performance quartiles. Only positive gain scores will be rewarded. PK-grade 2 core foundation 
teachers are rewarded based on the improvement of students in grade 2 and are not rewarded from the 
students they specifically teach. 


Indicator: Comparative Growth campus subject second-grade score. Comparative Growth scores are 
calculated for reading and for math. Teachers are awarded based on campus-wide second-grade student 
improvement in reading and in math. See the ASPIRE portal for more details on the calculation of 
Comparative Growth 
(http://static.battelleforkids.org/Documents/HISD/CGR/ComparativeGrowthModelOverview.pdf). 

The Campus Comparative Growth scores in reading and in math are rank ordered separately. Teachers at 
campuses in the first quintile (top 20 percent) for each subject are awarded. 


Grade/Subject Student Growth Awards Matrix 
Early Childhood-—Grade 2 Core Foundation Teachers 


Comparative Growth Score in Second Grade by Subject 
Reading Math 
Grade Quintile 1 Quintiles 2-5 Quintile 1 Quintiles 2-5 
PK to Grade 2 $1,750 $0 $1,750 $0 
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Grades 3-12 Core Foundation Teachers without Value-Added 


In this method, the gain scores for core foundation subjects at a campus are used for teachers who instruct 
students in core foundation subjects at grades 3-12, and do not have their own value-added analysis. 
Campuses are compared to other campuses for each subject based on the campus score for each subject 
and then placed into performance quintiles. Comparisons are done separately at each level (elementary, 
middle, and high school) for each core foundation subject. Only positive gain scores will be rewarded. These 
core foundation teachers are rewarded based on the improvement of students included in the EVAAS® 
analyses at their campus, not from the students they specifically teach. 

Indicator: EVAAS® campus subject score. Cumulative Gain Indices calculated for each subject: Reading 
(elementary school and middle school), Math, Language Arts (elementary school and middle school), 
Science, Social Studies and Reading/ELA (high school). Teachers are paid based on campus-wide student 
improvement in the subject(s) they teach. 

Campus subject gain scores are rank ordered by academic level. K-6 and K-8 campuses are rank ordered 
with elementary schools. Only employees at a campus in the first quintile are awarded. Awards are 
calculated separately for each subject taught and added together, not to exceed the max of $3,500. 


Grade/Subject Student Growth Awards Matrix 
Grades 3-12 Core Foundation Teachers without Value-Added 
Campus Progress Award Gain Score Across Grades 
One Subject Quintile 1 Quintiles 2-5 
Comparable Campus by Value-added Campus Gain Value-added Campus Gain Score 
Subject and Level Score 
Reading (ES/MS) $3,500 $0 
Math $3,500 $0 
Language Arts (ES/MS) $3,500 $0 
Science $3,500 $0 
Social Studies $3,500 $0 
Reading/ELA (HS) $3,500 $0 
Two Subjects Quintile 1 Quintiles 2-5 
Comparable Campus by Value-added Campus Gain Value-added Campus Gain Score 
Subject and Level Score 
Subject 1 $1,750 $0 
Subject 2 $1,750 $0 
Three Subjects Quintile 1 Quintiles 2-5 
Comparable Campus by Value-added Campus Gain Value-added Campus Gain Score 
Subject and Level Score 
Subject 1 $1.167 $0 
Subject 2 $1,167 $0 
Subject 3 $1,167 $0 
Four Subjects Quintile 1 Quintiles 2-5 
Comparable Campus by Value-added Campus Gain Value-added Campus Gain Score 
Subject and Level Score 
Subject 1 $875 $0 
Subject 2 $875 $0 
Subject 3 $875 $0 
Subject 4 $875 $0 
Five Subjects Quintile 1 Quintiles 2-5 
Comparable Campus by Value-added Campus Gain Value-added Campus Gain Score 
Subject and Level Score 
Subject 1 $700 $0 
Subject 2 $700 $0 
Subject 3 $700 $0 
Subject 4 $700 $0 
Subject 5 $700 $0 
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Individual Performance: Teacher Value-Added 


Purpose: Reward eligible core foundation instructional staff for individual efforts at improving student 
academic performance at the classroom/student cohort level through the application of teacher-level value- 
added analysis of student academic progress. 


People Included in Individual Performance: Teacher Value-added 


Core Foundation Instructional Staff: To be considered in this group, teachers must meet the definition of 
core foundation instructional staff (page 4) and must teach at least one and as many as five core foundation 
subjects in grades 3-10. Student linkages are required to be provided during the spring linkage process in 
order for a teacher to be considered in this category. A teacher-level value-added report must be produced 
in order to be considered in this group. 


Indicator: The Teacher Composite Cumulative Gain Index (TGI) is calculated across all grades and subjects 
a teacher teaches. The TGI is compared against the standard selected by HISD for teacher effectiveness 
levels using EVAAS® value-added, by which teachers are designated as well above average (2.00 or higher), 
above average (1.00 to 1.99), average (-1.00 to 0.99), below average (-1.01 to -2.00) or well below average 
(lower than -2.00). Teachers considered as “above average” receive awards. Teachers considered as “well 
above average” earn the maximum award. 


Individual Performance Awards Matrix 
Amount Awarded for Teacher Effectiveness Levels 
Average, Below- 
Well-Above Average or Well- 
Average Above Average Below Average 
Value-added Value-added Value-added 
Teacher Teacher Teacher 
Composite Composite Composite 
Cumulative Gain Cumulative Gain Cumulative Gain 
Index >= 2.00 Index 1.00 to 1.99 Index < 1.00 
$10,000 $5,000 $0 
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Examples: 


e Aeighth grade Math teacher whose composite value-added score from teaching Algebra | and Eight 
Grade Math is more than two standard errors greater than the district average would receive an 
Individual Performance award of $10,000. 

e A eighth grade Math teacher whose composite value-added score from teaching Algebra | is 
between one and two standard errors greater than the district average would receive an Individual 
Performance award of $5,000. 


Individual Performance Awards Matrix 
Amount Awarded for Teacher Effectiveness Levels 
Average, Below- 
Well-Above Average or Well- 
Average Above Average Below Average 
Value-added Value-added Value-added 
Teacher Teacher Teacher 
Composite Composite Composite 
Cumulative Gain Cumulative Gain Cumulative Gain 
Index >= 2.00 Index 1.00 to 1.99 Index < 1.00 
$10,000 $5,000 $0 
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2013-2014 ASPIRE Award Model Diagram 
Teachers & Campus-Based Staff 
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APPENDIX E 
ASPIRE Award for Teachers and Campus Leaders 2013-2014: Special Analysis 


Background 


Special Analysis refers to the alternative methods used to determine awards if staff are assigned to a campus where data are not available. This 
document describes the award exceptions and how they are calculated. Specific campuses which require Special Analysis are listed. 


For the regular methods used in award determination by staff category, please reference the document 2013-2014 ASPIRE Award Model Diagram: 
Teachers & Campus-Based Staff or 2013-2014 ASPIRE Award Model Diagram: School Leaders, posted on the HISD ASPIRE portal. 


Individual Performance 


There are no special analysis procedures for the Individual Performance award. Teachers who do not have their own EVAAS value-added analysis 
are placed into either Group 2, EC-2" grade Teachers, or Group 3, Grade 3-12 Teachers Without EVAAS. 


Group Performance: Teachers 


For teachers who do not receive teacher-level value-added gain indices, Group Performance teachers awards are calculated, in which student 
improvement is assessed through the use of campus-based indices that are calculated across grades for each core subject (Reading, Math, 
Language Arts, Science, and Social Studies). For teachers of students in grades 3-12 who do not have their own value-added reports, subject-level 
value-added gain indices are used to reward teachers by department at their campus. For teachers of students in grades EC-2, second grade 
comparative growth campus median scores are used to reward teachers of grades EC-2. 


There were three reasons for campuses to require special analysis under Group Performance: Teachers: 


1. Early Childhood Centers were matched with the campus with which they had the highest number of shared students over the past three years 
or equivalent strong relationship. The matched school provided the second grade comparative growth median, the quintile ranking, and the 
payout amounts for the teachers at these campuses for Reading and for Math. 

2. Elementary schools without value-added gain indices for one or more core foundation subjects were matched with the campus with which 
they had the highest number of shared students over the past three years or equivalent strong relationship. The matched school provided the 
value-added gain indices or comparative growth medians, quintile rankings, and payout amounts for the campuses in these analysis groups 
in these analysis groups for each subject that was missing results. If the campus has its own results for a specific subject, they were used; 
data from the paired campus were only used for subject(s) that had no data. 


e For EC to second grade teachers whose camp us did not have Comparative Growth median data, Group Performance awards were calculated 
using Reading and Math second grade comparative growth median data from the paired campus. 
For all other core foundation teachers, the appropriate subject-level gain index for the subject(s) they taught were used. 
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3. High schools without value-added gain indices for core foundation subjects were matched with the campus with which they had the highest 
number of shared students over the past three years or equivalent strong relationship. The matched school provided the value-added gain 
indices, the ranking, and the payout amounts for teachers at campuses in this analysis group for each subject in which paired data was 
necessary. If the campus had its own results for a specific subject, they were used; campuses were only paired for subjects with no data. 


School Name 


Paired School Name 


Reason for Special Analysis 


Halpin ECC Tinsley Elementary 1 
Neff ELC Neff Elementary 1 
Energized for Excellence ECC Energized for Excellence Elementary 1 
Farias Early ECC Moreno Elementary 1 
Mistral ECC Sutton Elementary ul 
King M. L. ECC Windsor Village Elementary 1 
Laurenzo ECC Burnet Elementary 1 
Bellfort Academy Lewis Elementary 1 
Young Learners Charter School Burbank Elementary 1 
Fonwood ECC Shadydale Elementary 1 
Elementary DAEP Eliot Elementary 1,2 
Harper Alternative School Black Middle School 2 
Las Americas Long Middle School 2 — Math and Reading Only 
Community Services Lamar High School 3 
HCC Life Skills Lamar High School 3 
Liberty High School Lee High School 3 
Advanced Virtual Academy Sharpstown High School 3 
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APPENDIX E (CONTINUED) 
Group Performance: Campus Value-Added 


Group Performance Campus Value-Added is based on the EVAAS® campus value-added composite gain index. The composite gain index is 
calculated across all subjects and grade levels at the campus. Several campuses did not have the student achievement data to allow for the 
calculation of value-added analysis. These campuses require special analysis. 


Schools without a value-added composite gain index were matched with the campus with which they had the highest number of shared students 
over the past three years or equivalent strong relationship. The matched school provided the value-added composite gain index, the quintile ranking, 
and the payout amounts for the campuses in this analysis group. 


There were two reasons for campuses to require special analysis under Group Performance: Campus Value-Added: 
1. Alternative/Charter without enough student test data for value-added analysis 
2. Early Childhood campus without students in grades included in analysis. 


School Name Paired School Name Reason for Special Analysis 
Community Services Lamar High School 1 
Harper Alternative School Black Middle School 1 
HCC Life Skills Lamar High School 1 
Halpin ECC Tinsley Elementary 2 
Neff ELC Neff Elementary 2 
Ashford Elementary School Shadowbriar Elementary 2 
Liberty High School Lee High School 1 
TSU Charter Lab School Lockhart Elementary 2 
Energized for Excellence ECC Energized for Excellence Elementary 2 
Farias ECC Moreno Elementary 2 
Mistral ECC Sutton Elementary 2 
King ECC Windsor Village Elementary 2 
Laurenzo ECC Burnet Elementary 2 
Bellfort Academy Lewis Elementary 2 
Young Learners Charter School Burbank Elementary 2 
Elementary DAEP Eliot Elementary 1 
Fonwood ECC Shadydale Elementary 1 
Advanced Virtual Academy Sharpstown High School ul 
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Group Performance: Campus Growth or Achievement 


Group Performance Campus Growth or Achievement is based on the percent of all students at or above the 50" national percentile rank across all 
grades on the Stanford/Aprenda for Math and for Reading for staff at elementary and middle school campuses. For staff at high school campuses, 
Campus Growth or Achievement is based on AP and/or IB participation and performance or improvement. Special analysis is done only at the 
elementary and middle school level for Campus Growth or Achievement. 


There were two reasons for campuses to require special analysis under Group Performance: Campus Growth or Achievement: 


1. These campuses are Early Childhood Centers serving students in grades EC-K, and they do not have Stanford/Aprenda data. These 
campuses are paired for Stanford/Aprenda Math and Reading. The paired campus provided the percent of students meeting the standard 
or the quintile ranking in improvement and the payout amounts for teachers and campus leaders. This type applies to Early Childhood 
campuses only. 

2. Schools that did not have sufficient Stanford/Aprenda data were paired to another campus. The paired campus provided the percent of 
students meeting the standard or the quintile ranking in improvement and the payout amounts for teachers and campus leaders. 


School Name Paired School Name Reason for Special Analysis 
Harper Alternative School Black Middle School 2 
Halpin ECC Tinsley Elementary 1 
Energized for Excellence ECC Energized for Excellence Academy uf 
Farias ECC Moreno Elementary 1 
Mistral ECC Sutton Elementary 1 
King ECC Windsor Village Elementary uf 
Laurenzo ECC Burnet Elementary 1 
Young Learners Charter School Burbank Elementary 1 
Elementary DAEP Eliot Elementary 2 
Bellfort Academy Lewis Elementary 1 
Fonwood ECC Shadydale Elementary A. 
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SCHOOL LEADER PERFORMANCE-PAY MODEL 2013-2014 


There are two major components of the ASPIRE Award Model for School Leaders: 1) Group Performance 
based on Campus Value-Added; 2) Group Performance based on Campus Academic Achievement. 


People Included in ASPIRE School Leader Performance Pay 


Principals: Certification for this position is required in order to be considered as a principal. To be 
considered in this group, employees must meet all general eligibility requirements and be the “principal of 
record” according to HR and PeopleSoft. 


Assistant Principals/Deans of Instruction: Certification for this position is required in order to be 
considered as an assistant principal or dean of instruction. To be considered in this category, employees 
must meet all eligibility requirements and be coded as an assistant principal, dean of instruction, or dean 
of students according to HR and PeopleSoft. 


Group Performance: Campus Value Added 


Purpose: Reward eligible school leaders for cooperative efforts at improving individual student 
performance at the campus level through the application of campus-level value-added analysis of student 
academic progress. 


Method for Group Performance: Campus Value-Added 


Indicator: EVAAS® Campus Composite Value-Added Gain scores calculated across grades and subjects 
to provide an overall campus value-added score (Cumulative Gain Index “CGI”). See the ASPIRE portal for 
more detailed information on the calculation of EVAAS scores. 


(http://static.battelleforkids.org/Documents/HISD/VA/Cumulative Gain and Composite Calculations.pdf) 


The Campus Composite Value-Added Gain Scores (CGI) are rank ordered by academic level. Staff at 
schools in the first quintile with positive (greater than zero) CGls receive awards. 


Campus Value Added Awards Matrix 
Comparable Campus by School Level Campus Composite Value-Added Gain Score 
(Across Subjects and Across Grades) 
Elementary Schools, Middle Schools Quintile 1 Quintiles 2 -5 
and High Schools Ranked Separately | Cumulative Gain Index Cumulative Gain Index 
Principals $10,000 $0 
Assistant Principals $5,000 $0 


Group Performance: Campus Academic Achievement 


Purpose: Reward eligible school leaders for cooperative efforts at meeting student achievement levels or 
improving student performance at the campus level. 


Method for Group Performance: Campus Academic Achievement 


Indicators: Stanford/Aprenda -- percent of all students at or above 50" National Percentile Rank (NPR); 
AP/IB -- percent of all campus students scoring at a level to earn college credit or growth in this percent 
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Elementary and Middle Schools 


This component of the Group Performance Award is designed to reward school leaders at elementary and 
middle schools for which 85% of all students across all grade levels have scored at or above the 50th 
National Percentile Rank (NPR) on 2013-2014 Stanford/Aprenda or for which the campus has exhibited 
significant improvement in the percent of students across all grades at this rank. Significant improvement 
is defined as being in the top quintile (top 20%) of schools within elementary school rankings or middle 
school rankings. Schools are rank-ordered at the elementary and middle school levels, separately. K-6 and 
K-8 schools are ranked with elementary schools. Schools are ranked and awarded separately for Math and 
for Reading. 


Campus Academic Achievement Awards Matrix - Elementary and Middle Schools 
Percent of Students At Distribution of Percentage-Point 
or Above 50" NPR) - Improvement in Percent of Students At 
Math or Above 50" NPR - Math 
Campus Staff Award Standard: 85 % Quintile 1 Quintiles 2 -5 

Principals $2,500 NA NA 
Met Award 5 — : 
Standard Assistant Principals $1,250 NA NA 
Did not Principals NA $2,500 $0 
meet Award | Assistant Principals NA $1,250 $0 
Standard 

Percent of Students At Distribution of Percentage-Point 
or Above 50‘ NPR) - Improvement in Percent of Students At 
Reading or Above 50" NPR - Reading 
Campus Staff Award Standard: 85 % Quintile 1 Quintiles 2 -5 

Principals $2,500 NA NA 
Met Award : —= 
Standard Assistant Principals $1,250 NA NA 
Did not Principals NA $2,500 $0 
meet Award | Assistant Principals NA $1,250 $0 
Standard 

High Schools 


This component of the Group Performance Award is designed to reward school leaders at high schools 
where students attain high levels of achievement or exhibit significant improvement in the percentage of 
their students with college-credit earning Advanced Placement (AP) and International Baccalaureate (IB) 
exam performance. 


APIIB Participation and Performance 


1. AP test data are extracted from the AP data provided by the College Board for 2012—2013 and 
2013-2014. Student-level IB test data are downloaded from the International Baccalaureate 
Organization and provided to the Department of Research and Accountability from campuses that 
participate in the International Baccalaureate program. Because the electronic data files for both 
AP and IB are dynamic, a cut-off date is used for reporting purposes. 

2. Total enrollment in grades 10-12 for each campus as of the fall PEIMS snapshot date in 2012 and 
2013 is collected. 

3. The participation/performance rate for each year at each campus is calculated using the number 
of students in grades 10-12 with at least one AP exam with a score of 3 or higher (an unduplicated 
count of students), by total grade 10-12 enrollment, all values expressed to the nearest tenth of a 
percentage point (0.1). The participation/performance rate for each year at campuses with both an 
AP and an IB program is calculated using the number of students in grades 10-12 with at least one 
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4. AP exam with a score of 3 or higher plus the number of students in grades 11-12 with at least one 
IB exam with a score of 4 or higher (an unduplicated count of students), by total grade 11-12 
enrollment, all values expressed to the nearest tenth of a percentage point (.1). 

5. Eligible staff ata campus that meets the 2013-2014 award standard of 40.0 percent are awarded 
for this strand component. There is no rounding to meet the standard (i.e., 39.9 percent is not 
awarded). 

6. Campuses that do not meet the standard are rank-ordered according to the percentage-point 
change in their participation/performance rates between 2012-2013 and 2013-2014, with both the 
underlying values and this change expressed to nearest tenth of percentage point. Only campuses 
with at least five students testing each year and hence a participation/performance rate for both 

7. Campuses rank-ordered by participation/performance rate changes between 2012-2013 and 
2013-2014 are placed into quintiles. Eligible school leaders at campuses ranked in the first quintile 
(top 20%) are awarded provided the participation/performance rate change is positive. 


Campus Academic Achievement Matrix — High Schools 
Participation/Performance Distribution of 
Rate: Percent of Students Percentage-Point 
in Grades 10-12 witha Improvement in 
score of 3 or higher (AP) Participation/Performance 
or 4 or higher (IB) Rate 
Campus Staff Award Standard: 40.0 % Quintile 1 | Quintiles 2-5 
Hees eet Principals S508 NA NR 
Standard : 
Did not Principals NA $5,000 $0 
meet Award | Assistant Principals NA $2,500 $0 
Standard 
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2013-2014 ASPIRE Award Model Diagram 
School Leaders 
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(©2013, Houston independent Schoo! Otstict HISD »« wwwhoustonicd.orgiASPIRE 


Group 2L 
Assistant Principals & Deans 


$2,500 


$7,500 


77 


